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A3 S TRACT 

This  report  Investigates  the  idea  of  utilizing  Luenberger's  minimal-order 
observer  as  an  alternate  to  the  Kalman  filter  for  obtaining,  state  estimates  in 
linear  discrete-time  stochastic  systems.  More  specifically,  this  dissertation 
presents  a  solution  to  the  problem  of  constructing  an  optimal  minimal-order 
observer  for  linear  discrete-time  stochastic  systems  where  optimality  is  in 
the  mean-square  sense.  The  approach  taken  in  this  dissertation  leads  to  a 
completely  unified  theory  for  the  design  of  optimal  minimal-order  observers  and  js 
applicable  to  both  time-varying  and  time- invariant  linear  discrete  systems. 

The  basic  solution  to  the  problem  is  first  obtained  for  that  class  of  systems 
having  Gaussian  white  noise  disturbances.  The  solution  is  based  on  a  special 
linear  transformation  which  transforms  the  given  time-varying  discrete-time 
state  equations  into  an  equivalent  state  space  which  is  extremely  convenient 
from  the  standpoint  of  observer  design j.  Design  of  the  observer  is  based  on  a 
special  observer  configuration  containing  a  free  gain  matrix,  K^,  which  is  chosei 
to  minimize  the  uean-3quare  estimation  error  at  time  "i."  The  solution  obtained 
is  optimal  at  each  instant  "i"  and  therefore  is  optimal  both  during  the  transienl 
period  and  in  the  steady-state.  Computation  of  this  optimal  gain  matrix  is 
recursive  as  in  the  Kalman  filter  algorithms,  however,  computational -y  the 
solution  is  much  simpler  than  for  the  Kalman  filter.  In  the  special  case  of  no 
measurement  noise,  the  observer  estimation  errors  arc  identical  with  those  of  the 
corresponding  Kalman  filter.  When  measurement  noise  is  not  excessive,  estimatioi 
errors  comparable  with  a  Kalman  filter  are  obtained. 

Next,  the  basic  observer  solution  is  extended  to  the  class  of  systems  for 
which  the  noise  disturbances  are  time-wise  correlated  processes  of  the  naucs- 
Markov  type.  In  considering  the  correlated  noise  inputs,  the  basic  observer 
structure  is  used  directly,  i.e.,  it  is  not  necessary  to  augment  the  plant  state 
equations  as  is  done  in  the  usual  Kalman  filtering  theory.  The  observer  free 
gain  matrix,  K^,  is  modified  appropriately  to  account  for  the  time-wise  correlation 
of  the  noise  inputs  and  is  chosen  again  to  yield  minimum  mean-square  error 
estimates  of  the  state  vector. 
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To  Illustrate  the  theory  and  application  of  the  observer  designs  developed 
In  the  dissertation  the  problem  of  designing  a  radar  tracking  system  is  consider< 
Examples  are  included  which  illustrate  clearly  the  practicality  and  usefulness  o; 
the  proposed  optimal  observer  design  technique. 

Finally,  a  host  of  topics  for  future  research  is  presented  in  the  hope  of 
stimulating  further  research  in  the  domain  of  observer  theory. 
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ABSTRACT 


This  report  investigates  the  idea  of  utilizing  Luenberger's  minimal-order 
observer  as  an  alternate  to  the  Kalman  filter  for  obtaining  state  estimates  in 
linear  discrete-time  stochastic  systems.  More  specifically,  this  dissertation 
presents  a  solution  to  the  problem  of  constructing  an  optimal  minimal-order 
observer  for  linear  discrete-time  stochastic  systems  where  optimality  is  in 
the  mean-square  sense.  The  approach  taken  in  this  dissertation  leads  to  a 
completely  unified  theory  for  the  design  of  optimal  minimal-order  observers  and  is 
applicable  to  both  time-varying  and  time-invariant  linear  discrete  systems. 

The  basic  solution  to  the  problem  is  first  obtained  for  that  class  of  systems 
having  Gaussian  white  noise  disturbances.  The  solution  is  based  on  a  special 
linear  transformation  which  transforms  the  given  time-varying  discrete-time 
state  equations  into  an  equivalent  state  space  which  is  extremely  convenient 
from  the  standpoint  of  observer  design.  Design  of  the  observer  is  based  on  a 
special  observer  configuration  containing  a  free  gain  matrix,  K^,  which  is  chosen 
to  minimize  the  mean-square  estimation  error  at  time  "i."  The  solution  obtained 
is  optimal  at  each  instant  "i"  and  therefore  is  optimal  both  during  the  transient 
period  and  In  the  steady-state.  Computation  of  this  optimal  gain  matrix  is 
recursive  as  In  the  Kalman  filter  algorithms,  however,  computationally  the 
solution  is  much  simpler  than  for  the  Kalman  filter.  In  the  special  case  of  no 
measurement  noise,  the  observer  estimation  errors  are  identical  with  those  of  the 
corresponding  Kalman  filter.  When  measurement  noise  is  not  excessive,  estimation 
errors  comparable  with  a  Kalman  filter  are  obtained. 

Next,  the  basic  observer  solution  is  extended  to  the  class  of  systems  for 
which  the  noise  disturbances  are  time-wise  correlated  processes  of  the  Gauss- 
Markov  type.  In  considering  the  correlated  noise  inputs,  the  basic  observer 
structure  is  used  directly,  i.e.,  it  is  not  necessary  to  augment  the  plant  state 
equations  as  is  done  in  the  usual  Kalman  filtering  theory.  The  observer  free 
gain  matrix,  K^,  is  modified  appropriately  to  account  for  the  time-wise  correlation 
of  the  noise  Inputs  and  is  chosen  again  to  yifild  minimum  mean-square  error 
estimates  of  the  state  vector. 


To  illustrate  the  theory  and  application  of  the  observer  designs  developed 
in  the  dissertation  the  problem  of  designing  a  radar  tracking  system  is  considered. 
Examples  are  included  which  illustrate  clearly  the  practicality  and  usefulness  of 
the  proposed  optimal  observer  design  technique. 

Finally,  a  host  of  topics  for  future  research  is  presented  in  the  hope  of 
stimulating  further  research  in  the  domain  of  observer  theory. 


1.  INTRODUCTION  AND  OUTLINE  OF  RESEARCH 


1 . 1  INTRODUCTION  AND  PROBLEM  STATEMENT 

The  general  state  estimation  problem  to  be  considered  in  this 
dissertation  is  described  simply  as  follows.  Given  the  linear  stochastic 
discrete-time  dynamical  system  characterized  by  the  equations 


xi+1  =  Ajx.+^ 


(1.1) 

(1.2) 


where 

x^  is  the  n-dimensional  state  vector 

is  the  m-dimensionai  measurement  vector 
w.  and  Vj  are,  respectively,  n-dimensional  and  m-dimensional 
independent  Gaussian  white  noise  sequences  having  zero  means  and 
covariances  Q-  and  R. 

and  the  initial  state,  is  an  independent  Gaussian  vector  with  mean 

and  covariance  M  .  It  is  desired  to  find  an  estimate  of  the  state  vector  x.  at 
o  —1 

time  "i"  along  with  its  associated  error  covariance  P^.  The  notation 

*  ' 

x.^  implies  the  estimate  is  to  be  based  on  all  the  measurements  obtained 
up  to  and  including^  obtained  at  time  "i."  It  is,  of  course,  also  desired 
that  this  estimate  be  optimal  in  some  sense,  i.e.,  with  respect  to  some 
given  performance  criterion.  There  are  many  performance  criteria  which 
have  been  presented  in  the  literature  pertaining  to  estimation  theory, 
however,  from  the  standpoint  of  mathematical  tractability  the  quadratic 


performance  criterion  is  most  appealing  and  it  was  this  performance 
criterion  which  was  used  quite  successfully  by  Kalman  [14].  If  it  is 
desired  that  the  estimate  be  optimal  in  the  mean* square  sense,  which 
implies  that  the  estimate  x^  minimizes  the  quantity  E  {llx^^xji2} 
then  the  solution  to  the  estimation  problem  is  the  well-known  Kalman  filter 
and  the  defining  equations  for  the  optimal  Kalman  estimator  are 

■^i+l/i+1  =  — i+l/i  +  Ki+l^i+l  *  Hi+l-i+l/i^ 

K  i+1  =  Pi+l/fHi+l  *Hi+lPi+l/iHi+l  +Ri+P 

Pi+l/i  =  AiPi/iV  +  Qi  <K5> 

Pi+1/i+l  =  (In*Ki+lHi+l)Pi+1/i  (1‘6) 

where  x.+1^.  =  A^x.^.  To  initialize  the  Kalman  filter  at  time  "i=0"  we  take 

x  .  =  x  and  ,  =  M  . 

—o/o  — o  o/o  o 

Although  in  theory  the  Kalman  filter  completely  solves  the  problem 
of  s~ie  estimation  in  the  mean-square  sense  for  linear  systems  with 
Gaussian  statistics,  its  inherent  complexity  and  implementation  have 
discouraged  widespread  application.  Building  the  Kalman  filter  essentially 
requires  the  simulation  of  the  entire  n-dimensional  system  being  observed. 
Equally  important,  the  Ricatti  equations  (1.5)  and  (1.6)  which  must  be 
solved  at  each  time  instant  "i"  to  obtain  the  optimal  Kalman  gain  matrix,  K^, 
have  been  the  source  of  much  trouble  in  the  real-time  mechanization  of 
Kalman  filters,  especially  in  the  case  of  large  dimensional  systems.  These 
numerical  and  computational  problems  associated  with  the  real-time 
implementation  of  Kalman  filters  have  led  many  researchers  to  seek  out 
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simpler,  less  optimal  solutions  to  the  minimum  mean-square  state 
estimation  problem. 

Early  work  in  this  area  was  done  by  Luenberger  [20-22]  who  showed 
that  when  the  system  (1.1)  and  (1.2)  is  time- invariant  and  no  noise  distur¬ 
bances  are  present,  the  state  vector  x.  may  be  reconstructed  exactly  with  a 
stable  linear  system  of  order  "n-m"  which  he  called  a  minimal-order 
observer.  Luenberger's  basic  idea  in  the  development  of  his  minimal-order 
observer  is  the  notion  that  since  there  are  "m"  independent  measurements 
already  available  it  should  be  possible  to  reconstruct  the  entire  n-dimensional 
state  vector  of  the  system  by  generating  only  ”n-m"  additional  quantities  and 
combining  them  appropriately  with  the  ,!m"  already  existing  outputs.  Of 
course,  Luenberger's  basic  assumption  that  the  system  inputs  are  free  of 
noise  is  not  always  satisfied  in  practice  and  this  comprises  a  fundamental 
limitation  to  his  original  work. 

Next,  Aoki  and  Huddle  [3]  extended  Luenberger's  work  to  include  the 
effects  of  noise  disturbances  w^  and  v. .  However  their  work  was  restricted 
to  time-invariant  systems  and  as  a  result  their  technique  is  not  directly 
applicable  to  the  more  general  time-varying  system  modeled  in  (1.1)  and 
(1.2).  The  technique  presented  in  Aoki  and  Huddle  [3]  was  essentially  to 
construct  a  minimal-order  observer  which  minimized  the  steady-state  mean- 
square  estimation  error.  However,  their  optimization  technique  is  compu¬ 
tationally  formidable,  even  for  the  simplest  of  systems,  and  as  a  result  does 
not  appear  to  have  been  used  to  any  large  degree  in  the  design  of  minimal- 
order  observers  for  practical  engineering  systems . 

Attempts  to  construct  optimal  observer  designs  based  on  a  purely 
deterministic  point  of  view  also  appear  to  have  been  fruitless.  Newmann  [23] 
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has  investigated  the  standard  optimal  control  problem  wuft  a  quadratic  cost 
function  for  the  case  of  linear  time*  invariant  systems  using  an  observer  in 
the  feedback  path  when  some  of  the  state  variables  are  not  measurable.  By 
counterexample,  he  clearly  demonstrated  that  if  nothing  is  known  about  the 
initial  conditions  of  the  state  vector  then  there  is  no  way  of  designing  the 
observer  so  that  the  cost  of  control  will  be  minimized.  In  fact,  if  nothing 
is  known  about  the  initial  conditions  then  high  cost  may  result  from  the  use  of 
an  observer  in  the  feedback  path. 

Dellon  [lO]  also  studied  the  deterministic  feedback  optimal  control 
problem  with  the  standard  quadratic  cost  function  from  the  standpoint  of  using 
a  minimal-order  observer  in  the  feedback  to  reconstruct  the  state  vector  x^. 
Dellon  considered  the  more  general  time-varying  discrete  system  in  the 
absence  of  noise  disturbances  and  has  indicated  similar  findings.  Restricting 
his  observer  design  to  that  class  of  observers  having  constant  and  equal 
eigenvalues  he  concluded  that  the  relative  degradation  in  cost  from  the 
optimal  (i.e.,  when  all  the  states  are  available  for  feedback)  cannot  be  made 
arbitrarily  small  by  proper  choice  of  observer  eigenvalues  but  the  relative 
degradation  depends  upon  the  original  optimization  problem. 

More  recently,  Ash  [4,  5]  developed  a  sub-optimal  minimal-order 
observer  estimator  design  applicable  to  both  discrete  and  continuous  time- 
varying  stochastic  systems.  His  main  goal  was  to  develop  a  stable  minimal- 
order  observer  which  provided  "acceptable"  mean- square  estimation  errors. 
Ash  himself  stated  that  his  work  comprises  an  engineering  solution  rather 
than  a  mathematical  solution  to  the  problem.  The  design  procedure  of  Ash 
is  a  "trial  and  error"  technique  which,  if  judiciously  applied,  may  result  in  a 
relatively  good  sub-optimal  estimator  in  comparison  to  the  corresponding 


optimal  Kalman  filter.  However,  in  the  utilization  of  Ash's  "trial  and  error" 
technique  it  is  not  at  all  clear  how  to  achieve  acceptable  performance  without 
trying  many  designs  and  selecting  the  best  design  out  of  those  which  were 
tried  out. 

To  review  the  proceeding  paragraphs,  we  have  introduced  the 
fundamental  problem  of  minimum  mean- square  estimation  for  linear  discrete 
stochastic  systems  and  have  indicated  Kalman's  optimal  solution  under  the 
assumption  of  Gaussian  noise  processes.  After  describing  Kalman's  filter 
and  its  inherent  problems  of  computation  and  implementation  in  real-time 
systems,  we  next  considered  the  idea  of  using  Luenberger's  minimal-order 
observer  as  an  alternate  to  the  Kalman  filter.  The  evolution  of  Luenberger's 
basic  observer  theory  is  then  presented  through  a  discussion  of  the  attempts 
of  various  researchers  to  design  observers  which  are  optimal  in  some  sense, 
both  from  a  deterministic  control  theory  point  of  view  as  well  as  from  a  more 
general  stochastic  estimation  theory  point  of  view.  Through  this  evolutionary 
discussion  we  have  attempted  to  provide  the  reader  with  a  smooth  transition 
from  Luenberger's  original  concept  of  a  minimal- order  observer  to  the 
ultimate  topic  of  this  dissertation.  It  should  be  clear  from  the  historical 
evolution  that  the  solution  lor  an  optimal  minimal- order  observer  has 
importance  not  only  from  a  theoretical  standpoint  but  also  from  the  standpoint 
of  designing  optimal  and  suboptimal  engineering  systems.  For  these  reasons, 
we  have  considered,  in  this  dissertation,  the  problem  of  constructing  an 
optimal  minimal-order  observer  for  discrete-time  stochastic  systems  and,  in 
the  spirit  of  Kalman,  have  chosen  the  mean-square  estimation  error  as  our 
performance  criterion. 
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1.2  OUTLINE  OF  THE  DISSERTATION 


Chapter  2  is  a  presentation  of  some  of  the  more  important  basic 
results  of  observer  theory  as  related  to  deterministic  discrete  time-varying 
systems.  Chapter  2  has  been  included  mainly  for  completeness  and  is 
intended  to  introduce  the  reader  to  the  basics  of  observer  theory.  Those 
familiar  with  the  material  may  skip  Chapter  2  without  loss  of  continuity . 

New  theoretical  results  are  given  in  Chapter  3,  in  which  is  presented 
the  fundamental  solution  for  the  optimal  minimal-order  observer  in  the 
case  where  the  noises  w.  and  v.  are  Gaussian  white  noise  sequences.  Also,  in 
Chapter  3  the  complete  generality  of  the  optimal  minimal-order  observer 
design  is  discussed  and  the  equivalence  of  this  observer  and  the  Kalman 
filter  is  demonstrated  for  the  special  case  in  which  the  measurement  noise, 

Vj,  is  identically  zero.  Chapter  4  treats  important  new  extensions  of  the 
basic  minimal-order  observer  design  to  the  class  of  systems  in  which  the 
noise  disturbances  w^,  v.  are  time- wise  correlated  processes  of  the  Gauss  - 
Markov  type. 

A  comprehensive  and  comparative  study  of  several  observer  designs, 
including  the  Kalman  filter,  the  optimal  minimal-order  observer,  and 
several  equal  eigenvalue  observer  designs,  is  presented  in  the  examples  of 
Chapter  5.  The  computer  simulations  of  Chapter  5  treat  the  practical 
problem  of  designing  a  radar  tracking  system  of  reduced  complexity  based  on 
the  optimal  minimal-order  observer  solutions  developed  in  the  previous 
chapters  3  and  4  of  the  dissertation. 

The  final  conclusions  and  recommendations  for  further  research  are 
presented  in  Chapter  6. 


6 


2.  SOME  FUNDAMENTAL  RESULTS  OF  DETERMINISTIC 

OBSERVER  THEORY 


2.1  MINIMAL-ORDER  OBSERVERS  FOR  DETERMINISTIC  SYSTEMS 

The  purpose  of  this  chapter  is  to  review  some  of  the  more  important 
fundamental  results  of  deterministic  observer  theory  which  have  been 
obtained  by  various  researchers  to  date .  We  begin  by  defining  the  concept  of 
a  minimal-order  observer  for  linear  discrete-time  dynamical  systems. 
Huddle  [13]  has  shown  that  a  completely  observable  n-dimensional  system 

xi+1  =  AA  +  BjUj  (2.1) 


with  m  independent  outputs 


ii  *  Hft 


can  be  "observed"  with  an  (n-m)-dimensional  system 

2i+i  *  FA +  G  A  +  dA 


such  that  the  output  of  the  observer  is  of  the  form 


(2.3) 


(2.4) 


where 


»*(£'•) 


<5o-tA> 


(2.5) 
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If  the  observer  initial  condition  is  chosen  such  that  z  =  T  x  then 

— o  o-o 

from  (2.4),  (2.5)  it  is  seen  that  =  T.^  for  all  "i"  -*  0  and  in  this  case  it 


is  possible  to  reconstruct  x.  exactly  from  and  z. .  The  observer  is  chosen 

r  Ti  l  .  . 

so  that  the  rows  of  aie  linearly  independent  and  the  estimate  of  x.  is 

taken  as 


'  l-l  r 

l  =  __L  -» 

Hi 

J 


(2.6) 


If  Zq  =  then  (2.6)  will  give  the  true  value  of  the  state  x^ 

Huddle  also  proved  that  for  the  system  (2.3)  to  be  an  observer  of  the 
state  in  (2.1)  it  is  both  necessary  and  sufficient  that  the  following  matrix 
relations  be  satisfied 


Ti+lAi  =  FiTi  +  PiHi 


(2.7) 


Gi  =  Ti+lBi  (2-8) 

rTi  T1 

Further,  since  it  is  necessary  that  the  matrix  inverse  I  I  exist, 


Huddle  postulated  the  inverse  to  be  partitioned  in  the  form  [pjv^]  and 
obtained  the  solution  of  (2 . 7)  to  be 


Fi  =  Ti+iVi 


Di  -  Ti+lAivi 


(2.10) 


where  +  VjHt  =  I. 

By  using  a  clever  coordinate  transformation  Dellon  [10]  next 
extended  the  work  of  Huddle  by  proving  that  the  eigenvalues  of  the  observer 
matrix  are  completely  arbitrary  provided  the  system  (2.1)  is  completely 
uniformly  observable.  To  do  this  Dellon  assumed  the  measurement  matrix 
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A22  +Ki+1A12*  may  **  arbitrarily  assigned.  But  (A^.A^1)  is  an 
observable  pair  at  every  "i"  provided  the  system  is  completely  uniformly 
observable.  Thus,  the  eigenvalues  of  F.  are  completely  arbitrary  at  each 
instant  "i". 

Returning  to  the  idea  of  state  reconstruction,  we  note  that  since  the 

entire  state  is  not  directly  accessible  it  is  unlikely  that  the  condition 

z  =  T  x  can  be  achieved.  This  implies  that  the  observer  error  (2.5)  will 
— o  o-o 

in  general  be  non  zero  and  the  estimate  Xj  in  (2.6)  will  be  in  error.  However, 
since  the  observer  eigenvalues  were  shown  to  be  completely  arbitrary,  it  is 
therefore  possible  to  reduce  the  observer  error  to  zero  as  rapidly  as 
desired.  Thus,  we  have  forced  the  estimate  x.  to  approach  the  true  state  x^ 
as  rapidly  as  desired. 


2.2  OBSERVERS  OF  ORDER  "nM 

Williams  [31  ]  has  considered  non- minimal  order  observers  and  has 
approached  the  observer  design  problem  with  the  idea  of  achieving  suboptimal 
Kalman  filtering.  Consider  the  n-dimensional  observer  given  as 

h+i  *  +  G*  +  di+iTi+i  (2-16) 

Here  the  observer  output  is  defined  by  the  relation 


(2.17) 


where  T^  is  an  n  x  n  nonsingular  matrix.  In  this  case  the  state  estimate 
x.  is  taken  to  be 


x, 


[2 


Williams  has  shown  that  the  system  (2.16)  is  an  observer  of  the  state  x.  in 


(2.1)  if  and  only  if  the  following  matrix  relations  are  satisfied 


Wi  *  FiTi + Di+iHl+iAi 


(2.19) 


Vi'VWi 


(2.20) 


The  corresponding  estimation  error  is  given  by  the  expression 


Go-Vo> 


(2.21) 


One  obtains  an  interesting  solution  to  (2.1 9)  by  taking 


D. , ,  =  T.  ,K  , 
i+l  l+l  l+l 


(2.22) 


where  Ki+1  is  an  arbitrary  n  x  m  gain  matrix.  With  this  choice  for  D^+1  the 
observer  equations  become 


FiTi  =  Ti+1<1  -  Ki+lHi+l>  Ai 


(2.23) 


Gi  *  Tt+fi  *  Ki+IHi+I>  Bi 


(2.24) 


An  interesting  observation  concerning  (2.23),  (2.24)  is  that  die  special  case 
where  Tj  =  I  and  K.  is  taken  to  be  the  Kalman  filter  gain  matrix,  the  observer 
obtained  is  identical  to  the  Kalman  filter.  That  is,  the  observer  equations 
become 


Fi  M1  -  Ki+1Hi+1)  Aj 


(2.25) 


Ci  =  (I-Ki+1Hi+1)Bl 


(2.26) 


Di+1  =  Ki+1 


(2.27) 
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Substituting  (2.25),  (2.26)  and  (2.27)  into  the  observer  system  equation  (2.16) 
gives  the  result 

h+l  -  A&  +  +  Ki+1  (l1+l  -  Hi+1  (Ai*i  +Bl“i>)  (2-28) 

which  clearly  shows  the  observer  to  be  identical  to  the  Kalman  filter.  If  the 
designer  picks  the  gain  matrix  K^+i  according  to  some  other  criterion,  the 
observer  then  may  be  viewed  as  a  suboptimal  Kalman  filter.  (For  example, 
the  gain  matrix  might  be  chosen  to  give  some  arbitrary  set  of  eigenvalues.) 
Therefore,  a  Kalman  filter  is  an  n-dimensional  observer  for  which  the 
weighting  matrix  Di+J  has  been  chosen  to  minimize  the  mean  square 
estimation  error.  It  is  also  interesting  to  note  that  in  the  more  general  case 
where  the  transformation  T.  is  a  k  x  n  rectangular  matrix  (k  <  n),  the 
solution  of  the  fundamental  observer  equation  (2.23)  is  an  aggregation  in 
the  sense  of  Aoki.[  2  ]  We  shall  not  pursue  this  idea  any  further  since  our 
interest  in  this  observer  formulation  will  be  primarily  the  design  of  n- 
dimensional  observers  based  on  the  selection  of  eigenvalues. 

By  a  judicious  choice  for  the  observer  transformation  T^,  Williams 
has  shown  that  it  is  possible  to  obtain  completely  arbitrary  eigenvalues  at 
each  instant  "i"  for  an  observer  of  the  form  (2.16).  He  considered  a 
completely  uniformly  observable  pair  (Aj,h.)  and  took  as  the  transformation 
Tj  the  following  matrix  product 


Observability  Matrix 


where  for  the  purpose  of  simplicity  we  have  considered  a  single  output  system 
The  results  are  easily  extended  to  the  multiple  output  case.  For  the 
particular  transformation  T.  chosen  the  observer  system  matrix  F.  is  in 
column  companion  form  and  has  arbitrary  eigenvalues. 


F.  = 

1 


A1  1  0 . 0 

x 

n 

A  .*  0  1 . 0 

X 

n-1 

• 

•  •  • 

• 

•  • 

*2l  *•  1 

• 

t 

• 

• 

Ajl  0  0 .  0 

X 

T.  . A.T. 
i+l  1  i 


-1 


[l  0  u  ...  o] 


Ti+i'<  i+l 


(2.30) 


-i+l  Ai  Ti 


-1 


Since  the  gain  matrix  K.+i  is  completely  arbitrary  and  the  matrix  Ti+i  is 
nonsingular,  from  (2.30)  it  is  apparent  that  any  desired  set  of  observer 
eigenvalues  may  be  obtained. 


2 . 3  APPLICATION  TO  OPTIMA  L  CONTROL 

One  of  the  fundamental  applications  of  observer  theory  is  in  the 


of  the  states  are  inaccessible  and  must  therefore  be  estimated  using  an 
observer.  For  example,  assume  it  is  required  to  obtain  the  control  u^  in 
(2.1)  which  minimizes  the  cost  function 

N 

j=  £  (2*3i) 

i=o 

where  and  are  respectively  n  x  n  and  p  x  p  symmetric  positive  definite 
matrices  for  all  "i"  in  the  interval  [0,  Nl.  The  feedback  law  which  minimizes 
J  is  known  to  be  a  linear  state  feedback  of  the  form  [30  ] 

Uj  =  A.x.  (2.32) 


By  assumption  the  entire  state  vector  x.  is  not  directly  available  for  measure 
ment  and  therefore  the  optimal  feedback  control  cun  not  be  implemented. 

The  alternative  considered  here  is  to  use  a  minimal-order  observer  to 
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construct  an  estimate  x.  of  the  state  Xj  and  apply  the  suboptimal  feedback 
control 


us 


(2.36) 


It  is  of  interest  to  determine  the  effect  of  the  observer  upon  the  control  law . 
Substituting  (2.6)  into  (2.36)  and  using  the  fact  that  +  V.I^  =  ^  it  is 
easily  verified  that  the  suboptimal  control  law  is  given  by  the  expression 


u,-AA  +  A1Pl(£FjW-T0Xo>  (2.37) 

It  is  clear  from  (2.37)  that  u.  is  the  sum  of  the  optimal  control  plus  an 
additive  term  due  to  the  incorrect  observer  initial  condition.  The  obvious 
conclusion  is  that  introducing  an  observer  in  the  loop  generally  results  in  an 
increase  in  cost  from  that  obtained  when  the  optimal  control  law  is 
implemented.  Further,  this  increase  in  cost  has  been  shown  by  Dellon  [10] 
to  be  of  the  form 

J-J* +£,'*„*  W-3*) 


where  the  positive  definite  matrix  (f.  satisfies  the  recursive  equation 


with 


(2.39) 


* 


N 


=  0 


To  determine  the  effect  of  an  observer  on  the  stability  properties  of  a  closed 
loop  control  system  in  which  it  is  used  we  assume  it  is  desired  to  control 
the  linear  system  (2.1)  by  the  linear  feedback  law 


Presumably  K.  will  be  chosen  by  the  designer  such  that  the  closed  loop  system, 
defined  by 


*i+l  =  (Ai+BiKi>*i 

(2.41) 

h  -  Hih 


achieves  some  desirable  response  properties,  which  will  always  include 
stability.  However,  the  actual  state  vector  jc  is  not  directly  available  and  a 
discrete  time-varying  minimal-order  observer  is  used  to  generate  an 
estimate  x^  of  the  state  x^.  The  estimate  x^  is  seen  from  (2.6)  to  be  of  the 
form 


(2.42) 


where  z-t  is  the  output  of  the  minimal-order  observer  and  ^  is  the  plant 
output  vector.  Applying  the  control  law  (2.40)  with  the  state  estimate  x. 

(2.42)  gives  the  closed-loop  state  equation 


(2.43) 


Also  applying  the  same  input  to  the  observer  gives 

*+1  =  Ti+l<Ai  +  BiKi>P£i  +TB.l<Ai  +  BiKi>ViHi*i  <2‘44> 

Combining  (2.43)  and  (2.44)  results  in  the  following  state  equation 


In  the  special  case  of  time- invariant  systems  it  is  clear  that  the  eigenvalues 
of  the  overall  system  axe  the  eigenvalues  of  A  +BK  plus  the  eigenvalues  of  the 
observer  system,  F.  By  assumption  the  closed-loop  system  A  +BK  has 
stable  eigenvalues  and  since  the  observer  is  designed  to  have  stable  eigen¬ 
values  then  the  overall  system  is  obviously  stable.  Hence  in  the  time 
invariant  situation  it  is  clear  that  the  observer  does  not  affect  the  optimal 
closed-loop  poles  at  all,  it  merely  adds  some  poles  of  its  own  [20 ]. 

Intuitively  one  would  expect  this  same  result  to  carry  over  to  the  more 
general  time-varying  case.  However,  although  it  is  true  that  at  any  fixed 
instant  ”i"  the  eigenvalues  of  the  system  matrix  (2.47)  are  the  eigenvalues  of 
Aj  +BjKj  plus  the  eigenvalues  ox  Fj,  this  does  not  imply  stability  of  the  overall 
system  (2.47)  in  any  rigorous  fashion.  To  prove  stability  in  the  more 
general  case  a  more  careful  consideration  of  the  state  equations  must  be 


It  is,  of  course,  assumed  that  the  designer  has  constructed  a  stable 
time -varying  observer.  Hence  the  observer-error  is  bounded  and  to  prove 
boundedness  of  the  closed-loop  state  vector  (2.47)  it  is  sufficient  to  prove 
boundedness  of  the  subvector  From  (2.47)  we  have 


(2.48) 


which  has  the  solution 


-i  =  ^i,  <A> 


i-1 


j=0 


WjWj 


(2.49) 


where 


- ■ G  f) 


teo'ToZo* 


(2.50) 


and  the  transition  matrix  cp.  .  is  defined  as 

J 


n.  <Ak+BkKk> 

k-j 


(2.51) 


Taking  the  norm  of  (2.49) 


i-1 


J=o 


li  G 

"—O' 


(2.52) 


Since  by  assumption  cp.  and  F.  are  uniformly  asymptotically  stable  we 

1,  o  1,0 

have  [10] 


||cpi  q!|  s  for  some  c^  >0  and  0  <  <  1 


(2.53) 


and 


*Fi  o11  *  c2®2  for  80xne  c2  >  0  and  0  <  <  1 


(2.54) 
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Let  1!B^KjP.  i  s  Cj  <  ®  and  (2.52)  becomes 


!:x.|!  ^c^  | ! xq i i  +  c ^CjC^  53  1  ^'£ 

“l  J=o  “ 


Evaluating  the  sum  in  (2.55)  gives 


***  (^) 


ii*^  -ci^i  i:*J!  +cic 


(2.55) 


(2.56) 


Thus  ;’Xj  is  bounded  for  all  "i"  and  since  lim  ,"x.  -*0  for  all  finite  £  then  the 

—1  —i  — o 

closedToup  system  (2.45)  is  uniformly  asymptotically  stable. 

2.4  ADDITIONAL  COMMENTS 

It  should  be  emphasized  at  this  time  that  the  design  procedures  of 
Huddle,  Dellon  and  Williams  involve  little  more  than  the  statement  that  the 
designer  is  free  to  choose  the  observer  eigenvalues  in  any  desired  fashion. 
The  fundamentally  important  problem  of  where  to  place  the  observer  eigen¬ 
values  has  nor  yet  been  solved  and  remains  a  perplexing  problem  to  the 
designer.  It  is,  of  course,  useful  to  know  that  one  may  design  (n-m)- 
dimensional  observers  or  n -dimensional  observers  with  arbitrary  eigenvalues 
at  each  instant  "i";  however,  without  the  added  information  of  where  to 
optimally  place  the  eigenvalues,  the  design  of  the  observer  remains  at  best  an 
ad  hoc  procedure. 

In  contrast  to  the  idea  of  artifically  picking  the  observer  eigenvalues 
to  provide  acceptable  system  performance,  we  shall  base  our  observer 
design  on  the  more  fundamental  objective  of  minimizing  the  effects  of  system 
noise  disturbances  upon  the  observer  derived  estimate  x^.  In  formulating  the 
observer  design  problem  in  a  more  general  stochastic  setting,  the  resultant 


observer  errors  will  be  dependent  upon  the  plant  noise  disturbances  and  from 
a  consideration  of  the  noise  induced  errors  an  optimal  observer  design  will  be 
obtained.  We  shall  obtain  a  solution  for  the  observer  matrices  F^,T^  and 
which  not  only  satisfies  the  fundamental  observer  equation  T.+iA.  = 

FiTi  +  D.Hj,  but  results  in  an  observer  system  which  is  also  optimal  in  the 
mean*square  sense. 
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3.  OBSERVERS  FOR  DISCRETE  TIME -VARYING  SYSTEMS  WITH 

WHITE  NOISE  INPUTS 


3.1  INTRODUCTION 

In  this  chapter  we  shall  focus  our  attention  upon  linear,  discrete -time 
stochastic  systems  for  which  the  dynamic  behavior  can  be  characterized  by 


the  following  set  of  equations , 


x . . ,  =  A.Xj  +B.u.  +  w. 

—1+1  l—t  i-i  — l 


=  HA  +^i 


(3.1) 


(3.2) 


where  x.  is  the  n-dimensional  state  of  the  system  at  time  "i",  u^  is  the  p- 
dimensional  known  control  vector  which  acts  upon  the  system  at  time  "i",  and 
y.  is  the  m-dimensional  measurement  vector.  The  initial  state  x,,  is  a 

*1  “*U 

Gaussian  random  vector  with  known  mean  and  covariance 


E  {x  }  =  x 
— o  — o 


Further,  the  noise  sequences  w-  and  v.  are  assumed  to  be  Gaussian  random 
vectors  with  known  means  and  covariances 


EtwjJ-  O  for  all  "i” 


E  (v.  J  =0  for  all  ’T 
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where  6.^  is  the  Kronecker  delta.  In  general,  the  covariance  R.  will  be  con¬ 
sidered  to  be  positive  definite  whereas  the  covariance  Q(  will  be  positive 
semi- definite.  The  various  random  vectors  are  also  assumed  to  be  mutually 
uncorrelated  so  we  have  the  relations 


E  {x  w.  'j  =  0 
— 0 — 1 

for  all  "i" 

E  {x  v. ' }  =0 

-O-l 

for  all  "i" 

E  {w . . v .  '3=0 

for  all  "i,  j 

Thus  it  is  assumed  in  this  chapter  that  the  noise  sequences  w.  and  v.  are  time 
wise  uncorrelated  sequences  which  shall  be  referred  to  as  Gaussian  white 
sequences.  In  the  interest  of  simplicity,  at  this  point  we  have  assumed  a 
model  for  the  white  noise  sequences  in  which  the  cross -covariance  matrix  of 
w.  and  v.  is  zero.  Later  in  this  chapter  we  shall  extend  our  results  to  include 
the  special  case  whereby  w.  and  v.  are  Gaussian  white  sequences  which  arc 
crosscorrelated  at  time  "i."  Also,  in  the  next  chapter  we  shall  consider  the 
more  general  situation  in  which  the  noise  sequences  w.  and  v.  arc  time-wise 
correlated  sequences  of  the  Gauss-Markov  type. 

3.2  DEFINITION  OF  THE  DISCRETE  OBSERVER  FOR  STOCHASTIC 

SYSTEMS 

Loosely  speaking,  for  stochastic  systems  an  observer  is  defined  to  be 
a  system  whose  output  vector,  z.+J,  is  an  estimate  of  the  quantity  Tj+ax.+1 
with  an  estimation  error,  _e.^ ,  depending  only  on  the  previous  estimation 
error,  £.,  and  the  plant  and  measurement  noises  w.,v. .  To  be  more  precise 


the  discrete  time-varying  system 


ii+l'F&+GA+DA 

is  called  an  observer  of  the  state  x^  of  the  system 

ii+i'AA+BA  +  Si 

if  at  each  instant  ”i"  the  following  relation  holds 


(3.6) 

(3.7) 

(3.8) 

(3.9) 


where  the  observer  estimation  error,  evolves  according  to  the  recursive 
equation 


ii+l-FA  +  DA-Tl+lSi 


(3.10) 


In  order  that  the  above  relations  hold,  it  is  both  necessary  and  sufficient 
that  the  following  matrix  equations  be  satisfied  at  each  instant  ”i" 


Wi  -  FiTi +  DiHi 


(3.11) 


Gi  "  Ti+lBi 


(3.12) 


Necessity  is  proved  as  follows.  Assuming  (3.6)  and  (3.9)  to  hold,  one  obtains 
the  result 


^i+lAi  "  FiTi  ‘  DiHi)  ii  +  (T l+iBt  '  c1)Hi 


+  -H-1  '  FA  ‘  D£i  +Ti+l-i 


(3.13) 


Since  (3.13)  must  be  satisfied  for  all  state  vectors  Xj  and  for  all  control 
vectors  u^,  take  xt  «  0  and  *  0 .  This  implies  the  following  result. 
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(3.14) 


-i+i  - F A  +  ‘  Ti+i"i 


Hence,  (3.13)  reduces  to  the  following 


fi+iAi '  FiTi '  +  <Ti+iBi  -  '  2 


(3.15) 


But  (3.15)  must  hold  for  all  state  vectors  x^  and  for  all  control  vectors  u^,  so 
take  u.  =  0  and  Xj  arbitrary.  This  implies  the  following  result. 

(3.16) 


Ti+lVFiTi+DiHi 


Also  in  (3.15)  we  may  take  x^  «  0  and  u^  arbitrary.  This  implies  the  following 
result. 


Gi  *  Ti+iBi 


(3.17) 


Conversely,  assume  equations  (3.11),  (3.12)  to  be  satisfied  at  each  instant 
"l".  Then  from  (3.6),  (3.7)  and  (3.8)  we  obtain  the  following. 


il+,  -  Tl+i*1+l  -  FA  +  D,(H*  +Vj) 

'  Ti+l<Vl  +BA  +*i> 


(3.18) 


Substituting  (3.12)  into  (3.18)  gives  the  following  result. 

— i+1  *  Ti+l-i+l  *  Fth  +^DiHi  '  Ti+lAi^-i  +  D£i  '  Ti+l-i  *3,19) 


Next,  since  *  -(DjHj  -  T^Aj)  from  (3.11),  we  obtain  the  result 

-i+1  ‘  Ti+l-i+l  *  Fi^i  ’  TA)  +  '  Ti+l-i  (3.20) 

Clearly,  (3.20)  implies  the  following  relations 

*  TjXj  +<£l  (3.21) 
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-i+1  =  Fi4i  +  Di— i  '  Ti+l-i 


(3.22) 


From  (3.22)  it  is  seen  that  the  observer  error  £i+i  at  time  "i+1"  depends 
only  upon  the  previous  observer  error  £.  at  time  "i"  and  also  on  the  noise 
disturbances  w.;v.. 

3.3  AN  OPTIMAL  MINIMAL-ORDER  OBSERVER  DESIGN 

The  discrete  time-varying  system  described  by  the  equations 

zi+1  *  +G.U.  +  D^  (3 . 23) 

VVi+ii  (3*24) 

where  z.,  ah  (n-m)-dimensional  vector,  is  called  a  minimal-order  observer 
of  the  state  x.  of  the  system  (3.1),  (3.2)  if  at  each  instant  "1"  the  following 
matrix  relations  are  satisfied 


r,+iVFiTi  +  DiHi 

(3.25) 

°i  -  Tt+lBi 

(3.26) 

ft  r1 

Jii — J  ®xists 

(3.27) 

Equation  (3.25)  is  the  fundamental  observer  equation  relating  the  observer 
system  matrices  F^  and  D^  to  the  observer  transformation  matrix  Tj.  In 
the  design  of  a  minimal-order  observer  the  additional  constraint  (3.27)  must 
also  be  satisfied  at  each  instant  "i”.  Using  this  fact,  a  general  solution  to 
the  observer  equation  (3.25)  may  be  obtained.  Rewriting  (3.25)  in 
partitioned  form 
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Ti+1A 


i-hHpr] 


(3.28) 


and  postulating  the  existence  of  the  matrix  inverse  to  be  of  the  form 


fr]  =IP‘|V- 


(3.29) 


where  P.  is  an  n  x  (n*m)  matrix  and  V.  is  an  n  x  m  matrix,  one  obtains  upon 


multiplying  (3.28)  from  the  right  by  the  above  inverse,  the  solution 


Fi  =  Ti+lAiPi 


(3.30) 


Di  -  Ti+lAiVi 


(3.31) 


From  (3.30),  (3.31)  it  is  seen  that  the  design  of  the  minimal-order  observer 
has  been  reduced  to  the  selection  of  the  single  matrix  T. .  This  is  seen  from 
(3.29).  Specification  of  the  matrix  Tj,  together  with  the  known  measurement 
matrix  H.  uniquely  defines  the  matrices  Pi  and  V.  and  from  equations  (3.30) 
and  (3.31)  is  seen  to  uniquely  define  the  observer  system  matrices  Fj  and  D.. 

The  observer  error,  e.,  was  shown  previously  to  satisfy  the  following 


difference  equation. 


— i+1  =  Fi— i  *Di-i  ’  Ti+1— i 


(3.32) 


Using  the  solution  (3.30),  (3.31)  together  with  the  error  difference  equation 
(3.32)  one  obtains  the  observer  error  covariance  given  as  (3.33). 

IS 1 '  •  Ti«  <VtWp,  'Ai ' + ViV'i  'Ai ' + TW '  <3-33> 


We  shall  define  the  matrix  fi,  to  be  the  following. 
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(3.34) 


f\“AiPiit£i'Pi'Ai+AiViftiViAi+Qi 

It  will  be  useful  at  this  point  to  partition  (3.33)  as  follows, 


e  e  '  =  T 
— i+l-i+1  M+l 


d 

d  n 

ii 

12 

^i 

°22 

T  ' 

S+i 


(3.35) 


where  ^  is  m  x  m,  *s  (n'm)  x  (n-m)  and  n*L2  =  is  m  x  (n-m).  The 
submatrices  f^2  an<l  ^12  are  obtained  as  partitions  of  the  matrix  ft. 
defined  by  (3.34). 

Equation  (3.35)  plays  a  fundamental  role  in  the  optimal  observer 
design  to  be  developed.  We  shall  next  obtain  the  covariance  matrix  of  the 
overall  estimation  error.  The  estimate  xi+1  of  the  state  vector  xi+i  is 
obtained  as  follows.  (The  notation  xi+1  shall  be  used  to  distinguish  between 
the  optimal  Kalman  filter  estimate  and  the  observer  derived  estimate.) 
Combining  the  observer  output  z.+1  with  the  measurement  gives  the 
following. 


*i+l 


*i+l 


i+1 


LHi+l 


*i+l  + 


e 

-i+1 


-i+1 


(3.36) 


Using  the  matrix  inverse  postulated  as  equation  (3.29),  we  obtain  the  estimate 
-i+1* 


-i+1 


lit+1 


-l+l  *  -l+l  +  r  i+1  I  Vi+lJ 
The  resulting  estimation  error  is  found  to  be 


(3.37) 
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(3.38) 


Finally,  the  error  covariance  e^e^ '  may  be  obtained  as  follows. 


(3.39) 

where  from  (3.32)  it  may  be  shown  that  £._^v._^ '  =  0. 

To  proceed  farther,  some  necessary  assumptions  must  be  made  about 
the  form  of  system  (3.1),  (3.2).  It  is,  of  course,  assumed  that  the  measure¬ 
ment  matrix  be  of  maximal  rank  at  each  instant  "i”  in  the  interval  of  interest. 
In  the  absence  of  measurement  noise,  if  Hi  did  not  exhibit  this  characteristic, 
then  some  of  the  measurements  would  be  linearly  dependent  and,  hence, 
redundant,  so  that  the  measurement  vector  could  be  reduced  to  a  linearly 
independent  set  without  any  loss  of  information.  In  cases  where  the  system 
outputs  are  corrupted  by  measurement  noise,  there  may  however  be  important 
reasons  to  consider  all  the  system  outputs,  including  any  redundant  ones. 

We  shall  not,  however,  treat  this  case  but  shall  consider  only  matrices  Hi  of 
full  rank . 

More  specifically,  it  is  assumed  that  the  first  "m"  columns  of  IT  (with 
a  possible  renumbering  of  the  states)  are  linearly  independent  for  all  ”i"  in 
the  interval  of  interest.  This  is  a  reasonable  assumption  in  view  of  the  fact 
that  usually  th^  system  outputs  are  affected  by  the  same  state  variables  even 
though  the  gains  involved  may  vary  with  time.  In  many  physical  systems  H. 
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3 


will  actually  be  a  constant  matrix  even  though  the  matrices  A.,  Bi  are  time- 
varying.  Therefore  H.  may  be  partitioned  as  follows. 

H.  =  (3.40) 

where  is  nonsingular  at  each  instant  ”i"  in  the  interval  of  interest.  Next 

(2) 

we  shall  assume  that  '  is  identically  zero  since  the  linear  transformation 


will  transform  the  original  system  to  the  desired  form  shown  in  equation 

(3.42).  Therefore,  without  loss  of  generality,  it  will  be  assumed  that  the 
measurements  are  of  the  form 


I,  -  Eim  I  0  1*,  +1, 


(3.42) 


To  complete  the  basic  observer  design,  it  remains  only  to  specify  the 

rx  l’1 

observer  matrix  T. .  Since  the  matrix  pp-  must  exist  at  each  instant 
"i",  the  most  logical  choice  for  the  matrix  Ti  is  given  below  as  (3.43). 


1  ] 
n-m 


(3.43) 


Kj  is  an  arbitrary  (n-m)  x  m  gain  matrix  which  will  be  chosen  to  minimize 
the  overall  estimation  error.  With  this  choice  for  the  matrix  T^,  the 
matrices  Pj  and  are  found  to  be  the  following 
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Substituting  (3.44)  into  (3.39)  gives  the  following  result 


— i+l^i+1 


■Ri+lKi+/ 


’Ki+lRi+l  ^i+l^i+1  +  Ki+lRi+lKi+l 


(3.45) 


Also,  substituting  (3.43)  into  (3.35)  gives  the  result 


— i+l^i+1 #  =  Ki+l°llKi+l  +  Ki+l°12  +  Q21K  i+1 '  +  ^2  ^3,46) 

The  optimal  gain  matrix  Ki+J*  may  now  be  determined.  From  (3.45)  and 
(3.46)  one  obtains 


“ace  ei+l£i+1'.  trace 


(3.47) 


+  trace  {K.+1(^1X  +  R.+1)  K i+1 '  +  K i+1^l2  +  Q21Ki+l '  +  n22^ 


'Completing  the  square"  in  (3.47)  gives  the  result 


trace  e^7  =  trace  R[+1 


+  trace  t[KJ+1  +  +Ri+P  ^°11  +  Ri+l^Ki+l  + 


+  n21^11  +  Ri+1*  "J  +  d2AAl+  Ri+P  °12  ^ 


(3.48) 


The  desired  optimal  gain  matrix,  Ki+r>  is  obtained  by  minimizing  the 
trace  e^e^ ' .  By  assumption  the  measurement  noise  covariance  Ri+1  is 
positive  definite.  Clearly,  the  submatrix  is  at  least  positive  semi- 
definite  so  that  the  matrices  +Ri+i)  and  (H^  +  R.+i)  1  are  positive 


definite.  Therefore  the  matrices 


if! 


and 


fr'i+l  +  ^21^11  +  Ri+P  ^nil  +Ri+l^Ki+l+ ^1^11 +  Ri+l> 


(3.49) 


(3.50) 


must  have  positive  diagonal  elements.  The  minimum  of  the  diagonal 
elements  of  ei+1e.+1 '  must  therefore  be  attained  when 


Ki+i +r4i  (nii +Ri+i)"1  *  ° 


(3.51) 


Clearly  the  optimal  gain  matrix  K*+1  is  given  by  the  expression 


-1 


2i'  ii  '  “H-r 


(3.52) 


The  minimal  estimation  error  obtained  when  is  taken  to  be  the  observer 

gain  matrix  is  found  by  substituting  equation  (2.39)  into  equation  (2.35).  Thus 
it  is  found  that 


min  trace  ei+1ei+1 '  =  trace  Ri+1  +  trace  -  ^4l^l+Ri+P  *^12^ 

(3.53) 

Design  of  the  optimal  minimal -order  observer  is  essentially  complete  at  this 
point;  it  remains  only  to  specify  the  resulting  observer  dyn  mical  structure. 

Previously  it  was  shown  that  the  observer  matrices  were  of  the  form 
F-  =  Ti+1A.P.  and  Dj  =  T^^A^V. .  Straightforward  substitution  of  the  observer 
transformation  matrix  Tl+J  [equation  (3.43)]  and  the  corresponding  matrices 
P^  and  Vj  [equation  (3.44)]  results  in  the  following 
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(3.54) 


Fi  =  A22  +  Ki+1A12 

=  A21  ’  A22Ki  +  Ki+1^A11  "  A12KP  (3.55) 

Also,  the  matrix  Gi  is  defined  explicitly  in  terms  of  the  observer  transfor¬ 
mation  T.+i  and  the  plant  matrix  B^  according  to  the  relation 


VWi  <3-5e» 

A  block  diagram  of  the  basic  observer  structure  is  shown  in  Figure  3.1  along 
with  the  appropriate  defining  equations  and  the  algorithm  for  obtaining  the 
optimal  observer  gain  matrix. 


3.4  INITIALIZATION  OF  THE  DISCRETE  OBSERVER 


In  the  case  of  the  recursive  Kalman  filter  equations,  the  a  priori 
statistics  x^  and  of  the  initial  state  x„  are  assumed  to  be  known.  This 
a  priori  information  is  needed  to  initialize  the  Kalman  filter.  Since  the 
optimal  observer  equations  (3.35)  and  (3.52)  are  also  recursive,  this  same 
information  is  needed  to  initialize  the  observer.  We  shall  therefore  assume 
that  the  a  priori  statistics  Xq  and  MQ  are  available  to  the  observer  system. 

Initialization  of  the  observer  proceeds  as  follows .  Let  Zj  =  TjX^  be 
the  observer  initial  condition,  where  xA  is  the  "expected  value"  of  the  state 
vector  Xj .  Since  =  z  A  -  TjXj  ,  then 

IJl '  =  Ta  tej-Iptej  - ix)  7  T4  '  (3.57) 

But  Xj-  Xj  =  A0(xQ-  hence  (3.57)  becomes 

SS'-WW  +  W  <3-“> 

To  initialize  the  observer,  define  the  covariance  matrix  fi  to  be 

’  o 


fi 

o 


AM  A 
0  0  0 


+Q, 


(3.59) 
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Figure-  3.1  Optimal  Minimal-Order  Observer  Structure. 


and  take  the  optimal  gain  matrix  K^*  to  be 

lT--cSi<fW1 


(3.60) 


3.5  SPECIAL  CASE:  CROSS  CORRELATED  PLANT  AND  MEASUREMENT 

NOISES  • 

In  the  interest  of  simplicity  we  have  assumed  that  the  original  model  of 
the  Gaussian  white  noise  sequences  is  one  in  which  the  cross -covariance 
matrix  of  w^  and  v.  is  zero.  We  shall  now  treat  this  important  special  case  in 
which  the  cross -covariance  matrix  of  w.  and  v^  is  non-zero  and  we  shall  show 
that  the  observer  design  technique  described  in  the  previous  sections  of  this 
chapter  is  directly  applicable  to  this  special  case  with  only  minor  modifications 
to  the  theory.  At  this  point  we  shall  assume  that  the  zero-mean  Gaussian  white 
sequences  wj  and  v.  are  characterized  by  the  covariance  relations: 

Etw^'i  =  Q,6(j 

Eiv-v/J 

El«!i^'i 

We  begin  by  computing  the  observer-error  covariance  matrix.  From  the 
basic  observer-error  equation  (3.10)  we  obtain  the  result 


ii+lfl+1 '  -  F# i ' '  V  +  'D.'+  T.+1w.w. '  T^ ' 


"  Di^i  — i '  Ti+1  ‘  Ti+1— i^i '  Di ' 


(3.61) 


But  since  Fj  *  T^AjPj  and  D^  *  T^A^,  substituting  these  relations 
into  (3.61)  gives 
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(3.62) 


5fcf  A+1 '  =  Ti+l<AiPi  /pi  'Ai '  +  AiViRiVi  /Ai '  +  Ti+1 ' 

-Ti+l<AiViSi  +  Si  'Vi  'Ai #)  Ti+1 ' 


Hence,  the  same  general  form  of  solution  is  obtained  as  in  the  previous 
uncrosscorrelated  noise  case.  Defining  the  matrix  CL  to  be 


a  =  A-P.TT  '  P. ' Ai '  +  A.V.RjV.  'A. '  +Q. 
1  1  i— i-i  li  l  i  *  l  l  l 


Aivisi  'WV 


(3.63) 


and  partitioning  (3.63)  as  before  we  obtain  the  result 


^4+l^i+l  "  Ti+1 


°ii 

f{2  ' 

-4 

“21 

f/ 

22 

l+l 


(3.64) 


It  is  immediately  obvious  that  the  observer  design  developed  previously  in 
this  chapter  applies  without  modification  from  this  point  on.  For  the  sake  of 
brevity  we  shall  state  only  the  final  results.  Taking  the  observer  trans¬ 
formation  matrix  to  be  of  the  form 


(3 . 65) 


The  optimal  gain  matrix  Ki+i*  is  found  to  be 


K 


(3.66) 


where  the  matrices  and  are  obtained  from  the  partitioned  Cl  matrix 
as  indicated  in  (3.64).  The  cross -covariance  matrix,  Sj,  alters  only  the 
computation  of  the  fij  matrix  as  indicated  in  (3.63). 
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3.6  EFFECT  OF  COORDINATE  TRANSFORMATION  ON  OPTIMAL  GAIN 

MATRIX,  Kj* 

Up  to  this  point  it  has  been  tacitly  assumed  that  "without  loss  of 
generality"  the  given  system  (3.1),  (3.2)  was  already  in  the  desired  canonical 
form.  However,  the  phrase  "without  loss  of  generality"  needs  to  be  justified 
since  for  many  dynamical  systems  the  desired  canonical  form  cannot  be 
obtained  directly  by  merely  renumbering  the  state  variables.  We  do,  however, 
assume  that  the  system  measurement  matrix,  Hj,  can  be  put  into  the  form 
(3.40)  and  then  the  linear  transformation  (3.41)  applied  to  obtain  the  desired 
canonical  equations.  If  this  transformation  need  be  used,  then  there  will 
be  a  modification  to  the  optimal  gain  matrix,  K.+j*,  due  to  the  linear  trans¬ 
formation  (3.41).  We  shall  now  consider  the  effect  of  this  linear  trans¬ 
formation  upon  our  optimization  technique  and,  in  particular,  we  shall  derive 
the  optimal  gain  matrix  taking  into  account  the  effect  of  the  linear 
transformation  (3.41). 

Assume  it  is  necessary  to  apply  the  linear  transformation  Xj  =  M^., 
where  M.  is  defined  in  (3.41).  Upon  performing  this  transformation  we  have 
the  measurements 


*i  = 


0  !Si  +^i 


(3.67) 


Let  the  observer  be  defined  by  the  system  (3.6)  where  now  we  take  the 
observer  output  to  be 

zi=  [Ki  |  !  j£j+  e.  (3.68) 


Combining  (3.67)  and  (3.68)  together  with  the  fact  that  =  M.£.  we  get  the 


result 


Z. 

-1 

Ki 

*n-m 

.*i . 

0 

rHi 

H.  1 

l 

x.  + 

—l 

e.  1 

—l 

0 

I 

V. 

. 

n-m  J 

L  — i  J 

(3.69) 


From  (3.69)  the  overall  estimation  error  covariance  is  found  to  be  the 
following: 


R. 

’RiKi# 

l 

-K.R. 

W 

i  l 

- 

+K  .R.K . ' 

l  l  l 

t 


'  H.(I>  1 

-h«'‘h<2> 

t 

I  1 

0 

*n-m 

(3.70) 


Equation  (3 . 70)  is  simply  the  statement  that  the  error  in  the  jc  coordinate 
system  is  Mi  times  the  error  in  the  coordinate  system.  That  is, 

(x.  -  xt)  «  -  5j)  (3.71) 

Performing  the  matrix  multiplication  indicated  in  (3.70)  and  taking  the  trace 
gives  the  result 

trace  eje’/  *  trace  '+ K^R.Kj '} 
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where  the  observer  error  covariance  is  of  the  form 


iiV  ■  Kt* +KiniV +(4‘X +t4V 


(3.73) 


Setting  the  gradient  of  (3.72)  (with  respect  to  the  free  gain  matrix,  K  ^  equal 
to  zero  gives  the  first  order  necessary  conditions  for  a  minimum.  Since 
(3.72)  is  quadratic  in  these  first  order  necessary  conditions  are  also 
sufficient  conditions  for  a  minimum.  To  obtain  the  gradient  of  (3.72)  one 
first  substitutes  (3.73)  into  (3.72)  and  expands  the  trace  e^eV  as  follows. 


trace  eje. '  =  tr  Ik {d'*  +  R^K  '  ]  +  2  tr  {fi^K { '3  +  tr  [d‘£ } 

+  tr  {(  •  )'(  •  )  KiOl1‘11Kl/}  +  2  tr  {(.)'(•  )  r^K. '} 

+  tr  i(0'(*)^'21} 

+  tr{(.)#(*)KiRiK/}+2tr  (  •  )Hi(1)  V^'J 

+tr|(Hl<1>  I)(H'<1,1)R*I 

(3.74) 

where  (  •  )  £ 

Using  the  formulae  given  in  Athans  [  6  ],  the  gradient  of  (3.74)  is 
evaluated  and  set  equal  to  zero  giving  the  result: 

(i +(->'(  •  >)Kt  (^iV  Rt> 

-  *(l  +  (  *  >'<  *  >)  -  (  •  >'  h}1}  \  (3.75) 
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But  since  the  matrices  y  +  (  •  ) '(  •  )j  and  +  R.  j  art  Pos*tivc  definite 
(hence  invertible)  we  obtain  from  (3.75)  the  result 

V  =  -  (^i1  +  £  •  3)  4/  +  Ri)_1 

where 

L  •  3=  ^1  +  (  •  )'(  •  )j  (  •  )'  H.^  Rj  (i.77) 

Finally  we  note  that  for  the  special  case  where  H.^  is  identically  zero,  the 
term  [  •  1  is  identically  zero  and  the  optimal  gain  (3.76)  reduces  to  the 
result  (3.52)  obtained  previously. 

3.7  GENERALITY  OF  THE  TRANSFORMATION  T.  »  [k.  |l  ] 

i  t  n-m 

At  this  point  one  might  ask  if  the  consideration  of  a  more  general 

observer  transformation,  T.,  could  result  in  a  further  reduction  in  mean- 

square  estimation  error.  To  be  more  specific,  can  the  mean-square 

estimation  error  be  reduced  even  further  by  taking  T.  =  _■  instead 

of  using  the  less  general  transformation  T.  =  [K.^jl  ]?  The  answer  to 
00  it  n-m 

this  question  is  an  unequivocable  "no”  and  in  this  section  of  the  thesis  we 
shall  present  a  proof  of  the  claim.  The  proof  is  straightforward. 

We  assume  that  the  measurements  are  already  in  the  desired 
canonical  form,  that  is: 

ii*  C'nd0 +^i  <3-78> 

We  consider  the  most  general  possible  observer  transformation,  T^,  which  is 
of  the  form 
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(3.79) 


zA  =  [K.(1)|Ki(2)]xi+ 


where  K.^  and  K.^  are  (n*m)  x  m  and  (n-m)  x  (n-m)  partitions  of  the 

-H.V1 


matrix  T\ .  Since  the  matrix  inverse 
instant  "l"  then  we  have  the  result 


nr . 

lTiJ  15 


required  to  exist  at  each 


det 


I 

0 

m 

K<1> 

k<2> 

l 

1 

=  det[K.(2)] 


(3.80) 


and  therefore  we  consider  all  transformations  T.  =  [K.^  |K^2^]  where 
(21  (2) 

and  K.'  ’  are  arbitrary  and  K.'  '  is  full  rank  at  each  "i."  We  shall  now  prove 
that  at  each  step  "i"  there  is  no  loss  of  generality  by  taking  K.^  =  m  and 
this  is  because  the  minimum  achievable  mean-square  estimation  error  is, 
in  fact,  independent  of  the  elements  of  the  partition  K.^2\ 

In  the  first  step  of  the  proof  we  treat  the  initialization  of  the  observer. 
Computing  the  mean- square  estimation  error  at  time  "i=l"  we  obtain  the 
result 


trace  e^  '  =  trace  Rj 


+  trace 


K  ^2)  '  K  W  '  +  K  K  iK  'K  i  2)  ' 


(3.81) 

But  the  observer  error  covariance  is  e,e.  '  =  T,0  T. '  where  fi  ^  AM  A  ' 

—1—1  1  o  1  o  o  o  o 

+  Qq,  so  expanding '  in  (3.81)  into  quadratic  terms  involving  the 
appropriate  partitions  of  the  matrix  f<0  gives  the  result  (3.82). 
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(3.82J 


e  e  '  =  K  (lh°  K  ^/+K  k  +k  (^)n°  v  (^)* 

-1-1  K1  Wll*l  +  *1  12K1  +K1  U21K1 


+  K  (2>n°  K  ^2)  / 
+  K 1  1 22K 1 


Substituting  (3.82)  into  (3.81)  and  "completing  the  square"  gives  the 
expression 


trace  '  -  trace  Rj 


)[K1<2>  *K1<1)  +1'^1<nil  +R1>’1][C?1  ■fRl][KJ(2)  *K!ll) 


-1 


+  trace 


+  f*21^11+RP  ]  +  ‘^22  *  ^21^11  +  ri21  |  ^3* 

Clearly,  to  minimize  trace  '  we  take 


83) 


-1 


k/2)  +r?2l{i?n+nl)'1  =  o 


(3.84, 


and  the  minimum  attainable  mean-square  error  is  given  by  the  result 


min  trace  e]e^'=  trace  Rj  +  trace  {i^2  -  f'21^11  +  Ri)  1  ^ 

(3.85) 

We  note  at  this  point  that  the  optimal  error  (3.85)  is  attained  independent 

(2) 

of  the  particular  choice  of  Kj'  .  Hence,  the  minimum  attainable  mean- 

square  error  is  independent  of  the  partition  K  ^  and  we  may  without  loss  of 

generality  take  K  *  I 

i  n-m 

For  all  cases  n=2, 3, . . i, i+1  the  solution  proceeds  as  follows.  At 


time  "i+1"  the  equations  of  interest  are  the  following: 


il+i=tIJ0]it+l+A+l 

z  -  [k^  Ik^  lx  +  e 
-i+1  ‘  l+l 1 K  i+1  J  — i+1  -i+1 


(3.86) 


Also, 


•%+A+1'-Twf'iTi+i' 


where 


Ci.  =  A.P.e.e.  'p.  'A.  '  +  A.V.R.V.  'A.  +  Q. 

i  l  t-t-i  ii  i  i  l  i  i  n 

Repeating  the  procedure  described  for  ”i=l"  we  find  the  mean-square 
estimation  error  at  time  "i+1"  to  be 


(3.87) 


«a«el+1e1+1'=  trace  Ri+, 


♦  trace  |  Kl+1  +  ^21  Hi +Ri+l)]  [fill+Ri+l] 

H+i  JKJ«  +t4iHi+Ri+i)'1] 

+  r42  ■  Hl+Rl+l)  “21 ’  [ 

Clearly,  to  minimize  trace  e^e.^ '  we  take 

kw1ki«+[4iHi+r1+i)1*0 


(3.88) 


(3.89) 


The  minimum  attainable  mean-square  estimation  error  at  time  "i+1"  is 
given  by  the  result 


4? 


min  trace  ei+iei+J '  =  trace  R.+1 

+  trace  {fi^2  -  +  R.+J)  '}  (3.90) 

and  this  optimal  result  (3.90)  is  attained  independent  of  the  particular 
(2) 

choice  of  K  >+j  .  Therefore,  at  each  step  n=2, 3,  . . i,  i+1, . . without  loss 

(2) 

of  generality,  we  may  take  K:+^  =  1  . 

3.8  EQUIVALENCE  OF  OBSERVER  AND  KALMAN  FILTER  WHEN 

V° 

Up  to  this  point  it  has  been  a  basic  assumption  that  the  measurement 
noise  be  non-zero  and,  in  tact,  it  was  more  strongly  assumed  that  the 
measurement  noise  covariance,  R^,  be  positive  definite  at  each  instant  "i." 
This  corresponds  to  the  case  where  each  measurement  component  is 
contaminated  by  an  independent  white  noise  disturbance.  A  special  case  ol 
particular  interest  is  the  opposite  extreme  where  the  measurements  are 
completely  noise-free,  that  is,  v.  =  0  for  all  "i."  We  shall  next  treat  this 
important  special  case . 

Rather  loosely  stated,  in  the  absence  ol  measurement  noise,  "m” 
of  the  system  states  are  known  exactly  and  it  is  only  necessary  to  estimate 
the  remaining  "n-m"  states.  In  this  particular  situation  it  is  clear  that  the 
Kalman  filter  is  degenerate  in  the  sense  that  it  reduces  to  an  "n-m"  dimen¬ 
sional  filter.  Noting  that  the  minimal-order  observer  is  of  dimension  ’’n-m,’ 
one  questions  whether  or  not  in  this  situation  (i.e.,  in  the  absense  of 
measurement  noise)  the  optimal  minimal-order  observer  is  equivalent  to  the 
Kalman  filter  in  the  sense  that  both  filters  provide  identical  mean-square 
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estimation  errors.  We  shall  demonstrate  that  this  property  is,  in  fact,  true. 


We  assume  the  system  equations  are  in  the  form 


rx(i)i 

— i+l 

■a‘h 

A12 

i 

4. 

rw**) 

—i 

x(2) 

-i+l 

A21 

A22 

(2) 
x>  ' 

—l 

r 

(2) 
w'  ' 

—l 

Ii=[lm,03Xi  (3.92; 

For  purposes  of  simplicity  the  plant  noise  covariance  is  assumed  to  be: 


(3.93) 


Using  the  Kalman  filter  algorithms  (see  Chapter  1,  equations 
(1.3  )  through  (1.6  )  it  is  easily  verified  that  for  the  system  defined  by 
(3.91),  (3.92)  the  mean-square  error  for  the  Kalman  filter  is 

lrate  pj+i/i+i  - 


trace 


(2)  At 

i/i  A22 


'  K/i/i 


A*  ' 
i/i  12 


A12PiA 


22 


(3.94) 


where  the  covariance  P  is  partitioned  in  tne  form 


which  is 


Next,  from  the  observer  error  covariance  _£i+j.£i+i  ' , 


e  e  '  =  T 
-i+l-i+1  1  i+1 


A1,  r,  c..z/A\j  +q[1) 


12  — i— i  12 


A  C  ™  /  A  1  / 

A22-i^i  A12 


aLtta!  ' 


12— i— i  22 


a  *  €  €  '  A*  '  +  Q<2> 

A22  — i — 1  A22+t2i 


T. 


(3.  Si 


it  is  found  that  the  optimal  observer  estimation  error  is 


traceei+1ci+1 


trace 


(• 


A22-A 


A*  e.e. 

22-i-i 


A*  e.e. 

i  12-n 


A  e  e 
12^i-i 


(3.  y 


Equivalence  oi  (3.94)  and  (3.97)  follows  directly  trpm  the  result  that  in  the 
case  of  no  measurement  noise,  e.e.  ;  =  P>/  .  This  result  is  obtained  bv 

’  -i— l  i/i 

inspection  oi  the  observer  estimation  error  covariance  '  and  the 

corresponding  relation  P,,/,.  for  the  Kalman  filter. 


4.  OBSERVERS  FOR  DISCRETE  SYSTEMS  WITH 
GAUSS  -  MARK  O  V  NOISE  INPUTS 

4.1  INTRODUCTION 

In  the  previous  chapter  we  have  limited  ourselves  to  estimation 
problems  in  which  the  system  disturbances  were  modeled  as  purely  random 
additive  white  sequences.  Clearly,  in  many  estimation  problems  the  system 
noises  will  be  modeled  more  accurately  as  additive  Gauss-Markov  sequences 
(time -wise  correlated  noise  sequences).  Sequentially  correlated  plant  noises 
can,  in  principle,  be  treated  by  introducing  shaping  filters  driven  by  purely 
random  white  sequences  resulting  in  sequentially  correlated  sequences.  [29  j 
However,  in  the  design  of  the  Kalman  filter  for  systems  with  sequentially 
correlated  noise  inputs  it  is  necessary  to  increase  the  dimension  of  the  state 
vector  to  be  estimated.  This  is  inconvenient  for  real-time  filtering  and, 
equally  important,  the  computation  of  the  Kalman  filter  gains  is  very  likely 
to  be  ill-conditioned.  Thus  it  is  desirable  to  seek  better  ways  to  handle 
sequentially  correlated  plant  disturbances  in  estimation  problems. 

4.2  OBSERVER  DESIGN  FOR  SYSTEMS  WITH  GAUSS-MARKOV  PLANT 

NOISE 

We  shall  now  extend  the  results  of  the  observer  theory  developed  in 
the  previous  chapter  to  the  problem  of  estimation  in  the  presence  of  time- 
wise  correlated  plant  disturbances.  This  problem  shall  be  treated  in  a 
straightforward  manner,  that  is,  the  state  equations  of  the  plant  will  not  be 
augmented  as  must  be  done  in  the  Kalman  filtering  theory.  Taking  this 
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direct  approach  will  result  in  an  observer  of  minimal  dimension.  To  be  more 
precise,  the  dimension  of  the  minimal-order  observer  will  be  the  same  as 
for  the  case  when  the  plant  noises  are  purely  random  Gaussian  white 
sequences.  The  order  of  the  observer  will  therefore  be  independent  of  the 
dimension  of  the  linear  system  required  to  generate  the  Gauss -Markov 
sequence.  The  resulting  observer  is  not  designed  to  provide  estimates  of 
the  extra  states  which  model  the  plant  disturbance;  only  the  original  system 
states  are  estimated.  This  is  highly  desirable  since,  in  practice,  one  usually 
is  only  interested  in  estimating  the  original  system  states.  We  shall  first 
consider  the  problem  of  estimating  the  system  state  vector,  x . ,  where  the 
noise  term  Wj  is  a  Gauss-Markov  sequence. 

Again  we  consider  the  discrete  system 


x1+1  -  AA  +  B  A  +  w, 


ii  -  +  Vj 


(4.1) 

(4.2) 


The  measurement  noise,  v.  ,  is  taken  to  be  a  Gaussian  white  sequence  with 
covariance 


E(Vj',=  Ri6lj 


However,  in  the  present  case  we  model  the  plant  disturbance,  Wj,  as  the  out 
put  of  a  linear  discrete  system  driven  by  a  zero-mean  Gaussian  white 
sequence.  The  plant  disturbance,  w . ,  is  therefore  a  zero -mean  Gauss- 
Markov  sequence  generated  as  the  output  of  the  following  system. 


-  ri*i + a 


(4.3) 


where  t}.  is  a  Gaussian  white  sequence.  The  covariance  matrix  of  the  noise 


vector,  w^+1,  denoted  as  Q^+1,  is  propagated  sequentially  according  to  the 


relation 


As  was  done  in  the  previous  chapter,  we  will  design  a  minimal  order  observer 
of  the  form 


*i+i  -  F& + Gtii + D& 


(4.5) 


where  is  an  (n-m)-dimensional  vector  and 


-i  ■  Tiii  +Si 


(4.6) 


As  before,  the  observer  error  evolves  according  to  the  recursive  equation 


i1+1  -  F,i,  +  D-  ' 


In  this  case,  from  the  basic  observer  error  equation  (4.7),  we  obtain  the 
*  observer  error  covariance 


-i+l-i+1  '  *  Ti+1  (ViiA  'Pi  'Ai '  +  AiVi*iVi  'Ai '  +  Qi>  Ti+1 ' 

*  WAiPiW+^'VV>Ti+l' 


(4.8) 


In  obtaining  (4.8)  we  have  used  the  results  that  F.  =  T.+^A^P.  and  D.  =  A. V. . 
At  this  point  it  is  noted  that  the  error  covariance  (4.8)  is  similar  in  form  to 
the  corresponding  expression  obtained  for  the  white  noise  problem  considered 
in  the  previous  chapter  [see  equation  (3.33)].  This  suggests  the  possibility  of 
applying  the  same  observer  design  technique  developed  in  the  previous 
chapter  to  the  present  problem  with  sequentially  correlated  plant  noise. 
However,  when  the  plant  noise  is  sequentially  correlated,  the  observer  error 
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covariance  (4.8)  contains  extra  terms  due  to  the  fact  that  the  observer  error 
at  time  "i"  is  correlated  with  the  plant  noise  at  time  "i".  Before  proceeding 
with  the  observer  design  we  shall  digress  momentarily  to  evaluate  the  cross 
correlation  _e.w. '  needed  in  the  solution  of  the  observer  error  covariance 


(4.8). 


From  (4.7)  we  have 


ii  =  F 


i,  1  +  jit  Fi.  j+1  D£j  ‘  PL  Fi,  j+1  Tj+1-J  i=2’ 3’  * 


(4.9) 


where  we  shall  use  the  notation 


Fi  j“  11  Fk 
l,J  k=j  k 


and  Fj  ^  =  I  for  all  "i".  Initializing  the  observer  as  described  previously 
in  Chapter  3,  the  initial  observer  error  becomes 


fl  ■  -TlAo<VV  •  Tl'i 


(4.10) 


Next,  using  the  relationships 


E  {(Xq  -  Xq)  ^ =  0  for  all  "i" 


E  l  v /w . '  J  =  0 


for  all  "i,  j’ 


(4.H) 


One  obtains  the  result 


-i-i /=  ‘  Fi,  j+1  Tj+1  -j-i *  l=l’2»  * 


(4.12) 


From  the  solution  to  (4.3)  which  is 


49 


(4.13) 


i-1 

w.  =  r.  w.  + V  r.  .  ^ 

-i  i,J-J  i,k+l-k 


»  'i 


one  obtains  the  result 


w  w.  '  -  w  w  V  T .  . /  =  Q.-'.  / 
-J->  -J-J  ‘,.1  J  i.J 


(4.14) 


where  the  covariance  is  obtained  from  (4.4).  Substituting  (4.14)  into 
(4.12)  gives  tile  expression 


i-1 


-i -i  "  ‘  ^  Fi,j+1  Tj+1  i,j 


(4.15) 


An  extremely  desirable  property  from  the  standpoint  of  filtering  and 
processing  of  measurement  data  is  the  recursive  nature  of  the  filtering 
equations  as,  for  example,  in  the  Kalman  filtering  technique.  Although 
(4.15)  characterizes  the  cross  correlation  v  w.  '  ,  it  is  not  in  the  desired 
recursive  formal.  To  obtain  a  recursive  equation  for  £.w.  ' ,  consider 
expanding  (4.15)  as  follows 


i-1 


— i+1  — i+1 #  "  *  ^  Fi 


J -o 


i+1,  J+l  TJ+1QJ  ‘  i+1,  j  Ti+lQi  i * 


(4.16) 


Using  the  properties  of  the  transition  matrix,  F.  ,  and  the  fact  that 

t,  j 

Fj  =  Tj+jAjP.  it  may  be  shown  that  (4.16)  is  of  the  form 

€.. .  w  “T '  =  T. ,  ,(AP.  Tw-'  -  Q.)  r.  ' 

-i+1  -t+1  i+l'  t  i  -t-i  i 


where 


(4.17) 


c.w/  =  -T.Q  V  ' 
-1—1  1^0  o 
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Returning  to  the  problem  of  designing  an  optimal  observer  for  the 
system  (4.1),  (4.2),  we  again  assume  without  loss  of  generality  that  the 
measurements  are  of  the  form 

=  ^m:!°-*-i+-i  (4.18) 


Thus,  the  same  observer  structure  used  previously  in  Chapter  3  will  ix- 
employed  here.  The  observer  output  is  therefore  taken  to  be  following 


zi  -  tK.ll _ ]*,  +  e 

—l  i  n-m  —l  — l 


(4.19) 


where  again  we  seek  the  optimal  gain  matrix,  K? ,  to  minimize  the  overall 
mean  square  estimation  error.  Following  closely  the  approach  of  Chapter  3, 
we  begin  by  partitioning  the  observer  error  covariance  (4.8)  as  follows. 


-i+l-i+l'  *  Ti+1 


f.  * 

11 

r  i 

21 

T  * 
l+l 


(4.20) 


where  the  partitions  of  the  matrix  are  conformable  with  the  partitioned 
matrix  Ti+j.  In  the  present  case,  the  matrix  f*.  is  defined  by  (4.21)  below. 


^  A,pi  W  VV  +Aivirtivi'Ai' +Q, 


Aipi  -i-, 


Vi 


pi'A, 


(4.21) 


The  next  step  in  the  observer  design  is  to  obtain  the  overall 
estimation  error.  From  this  point  on  the  results  are  essentially  identical 
in  form  to  the  white  noise  case  considered  in  Chapter  3.  Omitting  the* 
unnecessary  details,  we  obtain  the  result 
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trace  ei+1em'  =  trace  Ri+1 


(4.22) 


+  trace  {K i+1(^12  +Ri+1)  K  h-i  ' +  K i+i  r-ln  +  ^21  K  i+1 * +  ‘‘22* j 

Comparison  of  (4.22)  with  (3.47)  of  the  previous  chapter  leads  to  the 
obvious  conclusion  that  the  optimal  gain  matrix  is  identical  in  form  to  that 
obtained  for  the  white  noise  case.  Hence,  the  optimal  gain  matrix  is  given 
by  the  expression 


K  i+1  '  ‘Si  ^11  +  Ri+P 


(4.23) 


where  in  the  case  of  a  Gauss -Markov  plant  noise  the  computation  of  the 
matrix  f.  is  modified  to  account  for  the  cross  correlation  between  the 
observer  error  _e. ,  and  the  plant  noise,  Wj. 

4.3  OBSERVER  DESIGN  FOR  SYSTEMS  WITH  GAUSS -MARKOV 

MEASUREMENT  NOISE 

Next  we  shall  consider  the  problem  of  sequential  estimation  of  the 
state  vector  Xj  of  the  plant  (4.1),  (4.2)  using  a  minimal-order  observer  where 
the  measurements  are  corrupted  by  a  colored  noise  of  the  Gauss-Markov 
type.  The  plant  noise,  w.  ,  is  taken  to  be  a  Gaussian  white  sequence  with 
covariance 


(4.24) 


However,  here  we  model  the  measurement  noise,  Vj ,  as  a  Gauss-Markov 
sequence  generated  as  the  output  of  the  discrete  system 


v,+l  *  -ill  +ii 


(4.25) 
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is  a  zero-mean  Gaussian  white  sequence.  The  covariance  matrix  of  the 
measurement  noise,  v.^,  denoted  as  R^j,  evolves  with  time  according  to 
the  relation 


Ri«  *  Wi' 


(4.26) 


We  shall  next  optimize  our  canonical  observer  design  based  upon  the  system 
model  described  above.  From  the  basic  observer  error  equation  (4.7)  and 
the  fact  that  Fi  =  T.+^A.P.  and  D.  =  T.+iA.V.  it  is  easily  shown  that  the 
observer  error  covariance  is  of  the  form 


ii+lA+l '  -  Titl(A,P,S '  P)  'A, '  +  Alv,Riv1  'A, '  +  Q,)  Ti+J ' 


(4.27) 


Noting  that  the  observer  error  covariance  (4.27)  is  essentially  in  the  same 
form  as  (4.8),  it  is  clear  that  the  canonical  observer  structure  used 
previously  may  be  again  utilized  for  the  problem  of  colored  measurement 
noise.  Before  proceeding  with  the  observer  design  it  will  be  necessary  to 
obtain  a  recursive  solution  to  the  cross -covariance  _£.v. '  needed  in  the 
evaluation  of  the  observer  error  covariance  (4.27).  From  the  basic  observer 
error  equation  (4.7)  and  the  properties  of  the  noises  w^  and  v^  [namely  (4.24) 
and  (4,25)]  one  obtains  the  result 


i=2,  3, . . . 


(4.28) 


Since  the  observer  is  initialized  as  in  (4.10)  we  have  that 


(4.29) 
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From  the  solution  of  (4.25)  which  is 


i>j 


(4.30) 


i-1 


A  *  *  A 

where  9.  .  =  n  and  0.  .  =  I  for  all  "i"  we  obtain  the  result 

i,J  k=j  *  l»l 


v.v. '  *  v.v.  *  6.  .#=R.G.  . 1 

-J-i  -J-J  i.J  J  i.J 


(4.31) 


and  the  covariance  is  obtained  from  (4.26).  Substituting  (4.31)  into  (4.28) 
gives  the  result 


W«DjRiW+Wi' 


(4.33) 


Next  using  the  properties  of  the  transition  matrix  F.  .  and  the  relationships 

*1  J 

Fj  =  Ti+JAiPi  and  =  T.+1A.Vi  it  may  be  shown  that  (4.33)  is  equivalent  to 
-the  recursive  expression 


-i+l-i+1 


=  Ti+i(AiPt  fill 


+  A 


lViRi>  6i 


where 


(4.34) 


Without  loss  of  generality  we  shall  again  assume  the  measurements  to  be  of 
the  form  (4.18)  and  take  the  observer  transformation  to  be  of  the  form  (4.19). 
As  before,  the  observer  design  is  optimized  by  obtaining  the  free  gain 
matrix  K1+i  which  provides  minimum  overall  mean  square  estimation  error. 
The  matrix  defined  below,  is  partitioned  as  described  previously 
[see  (4.20)]. 
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i  Ti-rt  ‘i  "i  ’  i  i  1  1  “i 


(4.3! 


+  AiPiiA  Vi  Ai  +AiVi^i  Pi  Ai 


where  -i+l-i+1 *  =  Ti+1  °i  Ti+1  * 


Using  (3.38),  (3.44)  the  total  estimation  error  covariance  is  found 


to  be 


-i+l-i+1 


Ri+1 

-i+l-i+1 /_  Ri+1K  i+1 ' 

^i+l-i+1  * 

-  e  v  *  K  ' 

-i+A+l  i+l 

-i+l-i+1  *  Ki+lRi+l 

'  i+l  M+l^i+1 

+  Ki+lRi+lKi+l' 

(4.36 


Before  proceeding  with  the  minimization  of  the  mean  square 
estimation  error  we  shall  rewrite  the  quantity  £i+1v^ '  in  a  more  useful 


form.  We  partition  (4.34)  intu  the  following  form 

i  i 


•^i+l-i+1 #  *  Ti+1 
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i 


22 


(4.37 


where  n^4  is  the  upper  mx  m  dimensional  partition  and  v2^  is  the  lower 


(n-m)xm  dimensional  partition.  With  this  definition  it  can  be  shown  that  the 
mean  square  es'timation  error  is  given  by 


draee  e^e^i '  =  trace  ftl+1 


+  trace  (Ki+i  (^n**  nn  '  nn  /+Ri+l)Ki+l 

+  Ki+1  (ni21_  "22  #)  +  (a21  "  TT22l)  Ki+1  *  +  °22  I 


(4. 


Setting  the  gradient  of  (4.38)  with  respect  to  the  gain  matrix  K.+1  equal  to 
zero  gives  the  result 

Ki+l(Qll1‘nll  ‘"ll1*  +Ri+l)  +  (n21  'v22  )  =0  <4, 

The  minimizing  solution  is  given  by  the  following  expression  [l,  12,  24] 


where  (  )+  is  the  Moore-Penrose  pseudoinverse. 


(4. 


5.  EXAMPLES  ILLUSTRATING  THE  THEORY 


5.1  INTRODUCTION 

In  this  chapter  we  shall  illustrate  the  application  and  utility  of  the 
observer  design  techniques  developed  in  the  preceeding  chapters  3  and  4  of 
the  dissertation.  Toward  this  end  we  shall  consider  an  important  practical 
problem,  namely  the  design  of  a  radar  tracking  system  (sometimes 
referred  to  as  a  track -while-scan  radar  system)  based  upon  the  previously 
developed  theory  of  optimal  minimal-order  observers .  In  particular  we 
treat  two  special  cases  and  these  are  presented  in  the  following  sections  of 
this  chapter  as  examples  1  and  2.  The  purpose  of  these  examples  is  to 
demonstrate  in  a  clear  and  straightforward  manner  the  usefulness  of  optimal 
minimal-order  observer  theory  to  an  actual  and  realistic  design  problem.  In 
the  interest  of  simplicity  we  have  selected  target  models  for  our  examples 
which  are  sufficiently  simple  so  that  the  resulting  observer  design  equations 
are  not  too  unwieldy  and  cumbersome.  However,  the  target  models  will  be 
sophisticated  enough  so  that  the  results  of  this  design  study  are  realistic  and 
provide  useful  design  information  in  a  real  tracking  situation. 

In  the  first  example  we  consider  tracking  targets  having  white  noise 
acceleration  inputs,  that  is,  the  target  maneuver  is  a  white  noise  sequence. 
The  maneuver,  therefore,  at  one  sampling  period  is  completely  uncorrelated 
with  the  maneuver  at  a  different  sampling  period.  This  situation  prevails 
when  the  target  exhibits  constant  velocity  except  for  random  disturbances. 
Also,  the  measurement  errors  are  assumed  to  be  independent  from  measure¬ 
ment  to  measurement.  Typically,  ballistic  missiles,  orbital  and  suborbital 
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targets  are  modeled  in  this  way.  Example  1  is  intended  to  demonstrate  the 
ibasic  optimal  minimal-order  observer  design  for  systems  having  white  noise 
distrubances  as  treated  in  Chapter  3. 

In  the  sequel  we  shall,  of  course,  compare  the  resulting  performance 
of  the  best  minimal-order  observer  tracking  system  with  the  performance 
obtained  from  the  corresponding  theoretically  optimal  Kalman  filter  tracking 
system.  Also,  in  our  comparative  study  we  shall  investigate  the  constant 
eigenvalue  observer  designs  of  Dellon  [10]  and  Williams  [32]  and  we  shall 
compare  the  performance  of  these  designs  with  the  best  minimal-order 
observer  design. 

In  the  second  example  we  treat  a  slightly  more  sophisticated  (and 
perhaps  more  realistic)  target  model,  namely  the  case  where  target 
acceleration  is  characterized  as  a  time -wise  correlated  noise  sequence. 
Physically  speaking,  this  is  interpreted  as  the  situation  where  if  the  target 
being  tracked  is  accelerating  (maneuvering)  at  time  instant  "i"  then  it  is 
also  likely  to  be  accelerating  (maneuvering)  at  the  next  observation  time 
instant  "i+l."  Typically,  manned  maneuvering  targets  such  as  aircraft, 
ships  and  submarines  are  generally  modeled  in  this  way  [27  ].  The 
maneuver  properties  of  a  particular  target  are  characterized,  therefore,  by 
two  parameters,  and  these  parameters  are  the  target  maneuver  variance  and 
correlation  time  or  time  constant.  In  the  second  example  we  shall  treat  the 
maneuver  variance  as  constant  and  shall  vary  the  maneuver  correlation  time 
in  parametric  fashion.  Hence  the  resulting  tracking  accuracy  of  the  best 
minimal-order  observer  tracker  and  the  Kalman  tracker  is,  for  the  most 
part,  presented  graphically.  In  this  way  a  large  class  of  manned 
maneuvering  targets  is  considered  and  the  performance  of  the  tracking  system 
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for  any  single  particular  target  is  obtained  from  the  graphs  by  specifying  its 
particular  maneuver  properties.  The  purpose  of  example  2  is  to  demonstrate 
the  application  of  our  optimal  minimal-order  observer  design  technique  for 
the  case  of  systems  with  time -wise  correlated  noise  inputs  as  discussed  in 
Chapter  4  of  the  dissertation. 

5.2  EXAMPLE  1 

To  illustrate  the  application  of  minimal  order-observer  theory 
in  a  practical  design  situation  we  shall  consider  the  following  standard  radar 
tracking  problem.  For  purposes  of  simplicity  we  shall  treat  only  the  special 
case  of  a  single  spatial  dimension.  In  particular,  the  target  motion  is 
confined  to  motion  along  the  x-axis  of  the  usual  cartesian  coordinate  axes  and 
the  radar  is  assumed  to  provide  range  measurements  along  this  same  x-axis. 
Mathematically  the  target  equations  of  motion  for  this  simplified  one- 
dimensional  radar  tracking  situation  are  given  in  state  variable  representation 
by  the  following  l28]: 


=  Cl  0  0]  ^  +vt 


(5.2) 


y.  =  H,  x.  +  v. 

•*■1  l  —l  —l 

As  indicated  in  (5.2),  the  position  of  the  target  along  the  x-axis  is 

measured  by  the  ground  radar.  The  measurements  contain  observation  noise 

which  is  represented  by  an  additive  zero* mean  Gaussian  white  sequence,  v., 

2 

having  variance  (measurement  noise  variance) .  Practically  speaking,  the 

radar  measurement  error  would  be  range  dependent.  However,  in  this 

2 

simplified  example  we  shall  take  the  variance,  oy  ,  to  be  constant.  In  (5.1), 

the  input  w^  represents  the  change  in  target  acceleration  from  time  "i"  to 

time  "i+1"  and  for  purposes  of  this  example  wi  is  assumed  to  be  a  zero-mean 

2 

Gaussian  white  sequence  with  variance  a  (maneuver  variance) .  The  data 
rate,  T,  is  assumed  to  be  constant  so  that  target  position  is  observed  every 
T  seconds. 


One  additional  comment  concerning  the  observability  properties  of 
this  system  is  appropriate  at  this  time.  It  is  clear  that  the  system  (5.1), 
(5.2)  (defined  by  the  pair  of  matrices  (A,h))  is  observable  in  the  sense  of 
Kalman  [16],  Checking  the  rank  of  the  observability  matrix  we  obtain  the 


result 


Det  I  hA 


.  n  o  o  - 

Det  1  T  T2/2  =  T 


1  2T  2T 


(5.3) 


Hence  the  system  defined  by  (A,h)  is  observable  in  the  usual  sense  for  all 
data  rates  T  >  0 . 

Kalman's  filter  for  the  system  (5.1),  (5.2)  is  a  3-state  filter 
defined  by  the  following  equations: 

— i+i/i+1  =  — i+l/i  +  Ki+1  ^i+1  "  Hi+1  -i+l/i> 
where  Kalman's  gain  matrix  is 

K  i+1  =  Pi+l/i  Hi+1  ®*i+l  Pi+l/i  Hi+1  +  Ri+1^ 

and 

ii+l/i  =  Ai  k/l  <5*6> 

The  n-vector  x.+1^.+1  is  the  minimum  mean  square  estimate  of  x.+1  given 
measurements  up-to  and  including  time  "i+1"  (i.e.,  the  filtered  estimate) 
and  xi+1yi  is  the  minimum  mean  square  estimate  of  x.+1  given  measure¬ 
ments  up-to  and  including  time  "i"  (i.e.,  the  one -step -ahead  prediction). 

The  nxn  matrices  P.+jyi+i  and  P.+1^  are  the  covariance  matrices  of  the 
filtered  and  one -step -ahead  prediction  errors,  respectively.  These  matrices 
satisfy  the  following  recursive  equations . 

t+i/j  i  1/1  i  xi 

(5.7) 

Pi+l/i+l  *  "  Kl+1  Hi+1>  P i+l/i 

Design  of  Kalman's  optical  linear  filter  is  essentially  complete  at  this  point. 
The  structure  of  the  filter  is  given  in  equations  (5.4)  through  (5.6)  and 
initialization  of  the  filter  is  performed  in  accordance  with  (5.7). 
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Finally,  following  the  approach  taken  by  Singer  and  Monzingo  [28], 
we  shall  initialize  the  Kalman  filter  equations  by  taking  as  the  initial  state 
estimate 

Vo =  yG 

Xo/o=  T  (I  yo  '  2y-l +2y-2)  (^8 

Vo/o=~2  (yo'  2y-l  +  y-2)  • 

where  y  y  ^  and  y^  are,  respectively,  the  first,  second  and  third  radar 
measurements  received.  The  corresponding  covariance  initialization 
equation  for  (5.8)  is  given  by  the  following: 


Since  Kalman's  linear  filter  provides  the  best  attainable 
performance  in  terms  of  minimizing  the  mean- square  estimation  error,  it 
will  provide  us  with  a  useful  upper  bound  to  tracking  filter  performance. 
Hence,  our  purpose  in  presenting  the  Kalman  filter  here  is  to  provide  a 
reference  against  which  the  performance  of  our  minimal- order  observer  may 
be  compared.  We  shall  next  present  the  design  equations  for  the 
minimal-order  observer. 


Design  of  the  optimal  minimal- order  observer  for  the  system 
described  by  (A,h)  is  relatively  straightforward  and  involves  evaluating  the 
design  equations  derived  in  Chapter  3.  We  note  at  this  point  that  the  state 
equations  for  the  system  considered  in  this  example  are  already  in  the 
desired  observer  canonical  form  (that  is,  transformation  of  the  state  equations 
to  a  new  coordinate  system  is  unnecessary,  and  therefore  the  basic  design 
equations  of  Chapter  3  apply  without  modification.  For  convenience  we 
tabulate  the  appropriate  design  equations  below. 


V[KiW 


•'•[*•]  •  vM 


(5.10) 


(5.11) 


Ki+1  ~  '^21^11 +  Ri+1> 


(5.12) 


Fi  =  A22  +  Ki+1  A12 


(5.13) 


°i  =  A21  *  A22  Ki  “i-Ki+l(All  -  A‘l2  Ki> 


(5.14) 


We  shall  present  next  the  solution  to  the  minimal- order 
observer  equations  given  above.  Since  the  system  defined  by  (A,h)  has  n=3 
state  variables  and  m=l  output  measurement,  the  dimension  of  the  minimal- 
order  observer  is  n-m=2  and  therefore  the  observer  transformation,  T., 
satisfies  the  relationship 

z.  =  T.  x.  +  €. 

-i  i  — i  — t 


where 
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Hence,  T\  is  a  2  x  3  rectangular  matrix  containing  the  arbitrary  gain 
elements  k.^  and  k.^ .  These  arbitrary  gain  elements  are  adjusted  in  an 
adaptive  manner  to  minimize  the  overall  mean-square  estimation  error  at 
each  time  instant  "i."  Computation  of  the  corresponding  and  V.  matrices 
results  in  the  following: 


The  estimate  of  the  state  vector  x.  is,  of  course,  given  by  the  following 

ii'Pjii+Vii,  (5.17) 


with  P.  and  V.  as  defined  in  (5,16).  Next,  the  observer  transition  matrix, 
F.,  is  found  to  be  for  this  example 
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c 


k  <2> 
i+1 


Since  the  three  defining  matrices  (T.,  F.,  D. )  have  been  specified  uniquely  in 

terms  of  the  unknown  adaptive  gain  elements  k.^  and  k ^  [see  equations 

(5.15),  (5.18)  and  (5.19)  J,  design  of  the  basic  observer  structure  is 

essentially  complete.  It  remains  only  to  specify  the  computation  of  the 

optimal  gain  matrix  Kj  (that  is,  the  optimal  gain  elements  k.^  and  k52^) 

and  to  describe  the  observer  initialization  technique. 

Determination  of  the  optimal  observer  gain  matrix,  K.+1,  is  a 

recursive  procedure  which  uses  the  covariance  matrix 

U.  =  A.P.  e.c.  'P. '  A. '  +  A.V.R.V.  'A.  '  +  Q. .  For  the  system  defined  by 
i  i  l  -l-i  i  t  i  t  i  l  i  n  7 

the  state  equations  (5.1),  (5.2)  the  matrix  ; ^  is  found  to  be 


T  T  /2 


eT' 

-i-i 


2 

T  /2 


P;  'A. ' 


k(2)T2 
(1)  -  i 


.  fli  .  ll\. 


k*2)T2 


(■^)-  i.  (2)t  .  i- 


The  gain  matrix  K[+1  is  obtained  from  the  relation  Kj+1 

=  -n  1  (ft  *  +R.  S1  where  ft*  and  0,  ,l  are  the  appropriate  partitions  of 
21  '  11  i+1 

the  covariance  ft.  and  Rl+1  is  the  measurement  noise  covariance  at  time  "i+1 
Let  the  observer  error  covariance  be  the  following 


and  partition  the  matrix  Cl  in  (5.9)  in  the  form 
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J,33 

Finally,  the  optimal  gain  elements,  and  ki+i  can  **  written  in 

closed  form  as  follows 


w 


k  <2>  = 
i+1 


u,13 

— 1 ~T 

*11  +0v 


(5.24) 


where 


T4e  * 

•«  *  -  T^€  * 

Jli  'T  €11  +T  12  +  ^ 


°v2M1,-4*,<2>): 


i  1  =  T  €  1  +  _ 

12  1  11  r  2 


3T2-.  ‘  'T'3-'  1 


T  i 

12  .  22 
r  ri 


-  =v  ( 


1  *  Tk 


T2jc  ^ 

0).  i  W.,(D 


- — +  Tk.(2)^ 


(5.25) 
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Initialization  of  the  observer  requires  the  evaluation  of  the  covariance 

A 

matrix  Q  =  A  M  A  +Q  where  for  this  example,  since  M  =  P  ,  ,  we 
oooo^o  K  o  o/o’ 

obtain  the  result: 
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Finally,  the  optimal  initializing  gam  elements,  k^v  '  and  k^  are  found  to 
be: 


21c  2  7T3c  2 

v  .  m 

T  +  8 

0  T  o 

IO-  *  +  111  --  +  r 

yv  T  2  v 


(5.27) 
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5.3  PERFORMANCE  EVALUATION,  EXAMPLE  1 

We  shall  present  next  the  results  of  a  comparative  study  of  several 
tracking  system  designs  for  tracking  targets  as  modeled  in  example  1.  Among 
those  tracking  fillers  evaluated  are  included  the  Kalman  filter,  the  optimal 
minimal-order  observer,  the  optimal  steady-state  minimal  order  observer, 
and  the  constant  eigenvalue  observer  designs  of  Dellon  [10]  and  Williams  [32], 
A  comparison  of  the  tracking  accuracy  for  these  several  tracking  systems 


is  presented  graphically  in  figures  5.1  through  5.7.  Before  discussing  these 
computer  results,  the  following  descriptive  comments  are  necessary: 

1.  The  optimal  steady-state  minimal-order  observer  is  identical  in 
structure  to  the  optimal  (time -varying)  minimal-order  observer  design 
developed  in  this  dissertation,  with  the  exception  that  the  observer  gain 
matrix  is  constant  and  equal  to  the  steadystate  gain  matrix,  lim  K*  , 

i-ro 

obtained  from  the  minimal- order  observer  algorithms.  . 


2.  Delion’s  constant  eigenvalue  observer  design  is  also  identical  in 
structure  to  the  optimal  minimal-order  observer.*  However,  in  this  design 
the  observer  gain  matrix  is  chosen  to  yield  a  fixed  time- invariant  observer 
with  two  constant  and  equal  eigenvalues,  Hence,  to  design  a  Dellon-type 
observer  for  this  example  it  is  necessary  to  determine  the  observer  gain 
matrix,  K,  such  that  the  observer  F  matrix,  where  F  =  A 22  +  KA12,  has  the 
characteristic  equation  P(ty  =  (A-^)^  and  Aq  is  the  desired  observer  eigen¬ 
value.  This  observer  is  therefore  completely  specified  by  its  eigenvalue,  Ao> 
The  solution  is  easily  shown  to  be  the  following. 


1  T 


0  1 


[T  T/2] 


(5.28) 


*Dellon's  work  is  discussed  in  Section  2.1,  Chapter  2. 
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...  A  +  2  A  -  3 

,(*>_  o  o 
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3.  Williams'  constant  eigenvalue  observer  design  is  identical  in 

structure  to  a  Kalman  filter  except  instead  of  implementing  Kalman's 

gain  matrix  the  observer  gain  matrix  is  chosen  to  yield  an  observer  with 

three  constant  and  equal  eigenvalues.*  To  design  a  Williams-type  observer 

for  this  example  it  is  necessary  to  determine  the  triple  of  matrices  (T,  F,  D) 

satisfying  the  fundamental  observer  equation  TA  =  FT  +  DHA  such  that  the 

3 

observer  F  matrix  has  the  characteristic  equation  P(A)  =  (A-A^  and  \Q  is 
the  desired  observer  eigenvalue.  Hence,  the  Williams'  observer  is  also 
completely  specified  by  its  eigenvalue,  Aq.  For  the  system  (A,H)  of 
example  1  the  solution  is  found  to  be  the  following. 
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•Williams'  work  is  discussed  in  Section  2.2,  Chapter  2, 
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Cont. 


Having  described  each  of  the  observer  designs  considered  in  this 
comparative  study  we  are  now  ready  to  discuss  the  computer  results 
presented  graphically  in  Figures  5.1  through  5.7.  In  this  study,  the  following 
typical  radar  and  target  model  parameters  were  used: 


1.  Radar  range  measurement  accuracy,  cy  =  10  (ft.) 

2  2  2 

2.  Target  maneuver  variance,  am  =  100  (ft. /sec.  ) 

3.  Data  Rate,  T  =  1  second 


Presented  in  Figures  5.1  and  5.2  is  the  total  mean- square  estimation 
-  error  versus  the  discrete  time  index  "i"  (that  is,  the  trace  ((Xj-x.)  • 
(ij'.ij)*}  versus  time  "i").  Figure  5.1  demonstrates  the  results 
Delion's  design  for  observing  eigenvalues  of  \=  .3,  .4,  .45  and  .5  and  also 
demonstrates  the  results  of  the  Kalman  filter,  the  optimal  observer*  and 
the  optimal  steady-state  observer.  With  reference  to  Figure  5.1,  it  is  clear 
that  the  overall  steady-state  estimation  error  of  the  optimal  observer  is 
increased  from  that  of  the  Kalman  filter  by  approximately  5.9%  whereas  for 
the  best  possible  equal  eigenvalue  design  (^  =  .45)  the  corresponding 

*For  the  sake  of  brevity  we  shall  refer  to  the  "optimal  minimal- order 
observer"  as  the  "optimal  observer." 
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degradation  is  on  the  order  of  16.5'/c.  Therefore  it  is  concluded  that  the 
steady-state  performance  of  the  optimal  observer  is  superior,  by  far,  to  the 
oest  equal  eigenvalue  observer  design.  Inspection  of  the  transient  behavior 
also  shows  this  same  general  trend  to  be  true,  as  seen  in  Figure  5.1. 

(Note  also,  in  this  example,  that  the  optimal  steady-state  observer  provides 
excellent  tracking  performance,  not  only  in  the  steady-state  but  during  the 
transient  period  as  well) . 

Another  interesting  comment  can  be  made  concerning  the  results  of 
Figure  5.1.  In  viewing  the  results  of  Figure  5.1  it  is  seen  that  the  best 
steady  state  performance  is  achieved  with  X^  =  .45,  however  during  the 
transient  period  the  design  with  XQ  =  .4  performs  best  indicating  that  to  obtain 
acceptable  tracking  performance  (during  both  the  transient  period  and  in  the 
steady-state)  based  on  selection  of  observer  eigenvalues  it  is  perhaps 
necessary  to  select  the  eigenvalue  in  an  adaptive  manner.  This  idea  was  first 
proposed  by  Bona  [  7  ]  where  it  was  suggested  that  the  response  time  could  be 
decreased  by  using  one  eigenvalue  during  the  transient  period  and  after  a 
given  time  the  eigenvalue  could  be  increased  to  improve  steady-state  estima¬ 
tion  accuracy. 

Similar  comments  can  be  made  about  the  performance  of  the 
Williams'  3-state  observer  design  as  seen  from  Figure  5.2.  To  achieve  the 
best  steady-state  tracking  performance  in  this  case,  one  takes  the  observer 
eigenvalue  to  be  XQ  *  .35.  However,  it  is  seen  in  Figure  5.2  that  XQ  =  .3 
provides  much  better  tracking  accuracy  during  the  transient  period.  In 
regards  to  steady-state  tracking  performance  it  is  sefen  that  for  the  best 
eigenvalue  (XQ  =  .35)  the  overall  mean-square  error  is  increased  by 
approximately  .10.7%  from  that  of  the  Kalman  filter. 
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Figures  5.3  through  5.7  provide  a  breakdown  of  the  overall  mean- 
square  estimation  error  into  target  position,  velocity  and  acceleration  error 
Figure  5.3  shows  the  mean-square  error  in  the  position  estimate  versus 
discrete  time  "i"  for  each  of  the  observer  designs  being  evaluated.  Suite 
Williams'  observer  is  a  3-stale  filter,  it  provides  some  improvement  in  the 
estimate  of  target  position  whereas  the  minimal-order  observer  de:-igns 
(including  the  optimal  observer,  the  optimal  steady -state  observer  and 
Dellon's  equal  eigenvalue  observer)  do  not  improve  the  accuracy  in  target 
position.  This  is  no  great  loss  however,  since  even  the  Kalman  filter  only 
improves  the  accuracy  in  target  position  from  its  initial  value  of  10  feet 
r.m.s.  to  approximately  9  feet  r.m.s.  in  the  steady  state.  From  the  stand¬ 
point  of  good  tracking  system  design  this  slight  improvement  in  position 
accuracy  is  hardly  worth  the  effort.  Reduction  in  the  size  of  the  tracking 
filter  from  3  states  to  2  states  will  result  in  significantly  reduced  computer 
processing  requirements  while  yielding  only  a  slight  loss  in  position 
accuracy. 

Figures  5.4  and  5.5  present  the  corresponding  mean-square  error  in 

the  estimate  of  target  velocity.  From  these  curves  one  obtains  the  relative 

degredation  in  the  velocity  estimate  (ft. /sec.)  from  that  of  the  Kalman  filter 

to  be,  in  the  steady-state,  3.3%  for  the  optimal  observer,  6.2%  for  the 

Williams  observer  with  A  =  .35  and  11.2%  for  the  Dellon  observer  with 

o 

AQ  =  .45.  Similar  comments  can  be  made  concerning  the  mean-square 
■errors  in  the  estimate  of  target  acceleration  shown  in  Figures  5.6  and  5.7. 
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Estimation  Error  vs.  Discrete  Time  ' 


(ft.) 


Position 


Figure  5.4  Mean-Square  Error  in  Velocity  vs.  Discrete  Time  "i." 


Figure  5.6  Mean-Square  Error  in  Acceleration  vs.  Discrete  Time 


5.4  EXAMPLE  2 


We  shall  next  consider  the  important  problem  of  radar  tracking  of 
manned  maneuvering  targets  as  recently  studied  by  Singer  [27].  In  this 
example  the  target  acceleration  is  modeled  appropriately  as  a  time-wise 
correlated  noise  sequence  of  the  Gauss-Markov  type.  The  fundamental  state 
equations  describing  the  system  in  one  dimension  are  again  given  by  (5.1), 
(5.2).  All  the  basic  definitions  and  assumptions  of  example  1  are  therefore 
assumed  to  hold  with  the  exception  that  in  example  2  the  state  driving  noise, 
w^,  is  taken  to  be  a  scalar  Gauss-Markov  sequence.  Hence,  w-  is  obtained 
as  the  output  of  the  discrete-time  linear  system 


wi+i  =  pwi+T:i 


(5.30) 


2  2 

where  r>.  is  a  zero-mean  scalar  white  sequence  with  variance  oM  (1-p  )  and 
p  is  the  correlation  between  successive  maneuver  samples.  Since  wi  in  (5.30) 
is  a  non-white  sequence,  the  Kalman  filter  equations  cannot  be  directly 
applied  and  it  is  necessary  to  "whiten"  the  input  noise  before  the  Kalman 
equations  can  be  used.  The  usual  solution  to  the  "whitening"  approach  is  to 
augment  the  state  equations  (5.1),  (5.2)  using  the  relation  (5.30). 

When  this  is  done  we  obtain  the  following  "augmented"  state  equations. 


A(a)  x(a) 

Ai  -i 


(5.31) 


(5.32) 


It  is  clear  that  Kalman's  filter  for  the  above  augmented 
system  is  a  4-dimensional  filter  and  to  obtain  the  solution  for  Kalman's 
optimal  weighting  matrix  it  is  necessary  to  solve  recursively  the  augmented 
Kalman  algorithms 


x(a)  =  A(a)x(a)  +  K(a)  (v(a)  -  H(a)  A(a)  J(a)\ 
*i+l/i+l*Ai  -i/i  Ki+1  ^i+l  Hi+lAi  *i/i> 


K(a)  _ 

Ki+1  ‘ 


i+l/i 


H(a)r  /it (a) 


W  pW  +  H 

i+1  r  i+l/i  ni+l  +  Ki+1> 


(5.33) 


p(a)  _  *(a)  p(a)  .(a)  Q(a) 
i+l/i~Ai  i/i  i  +^i 


p(a)  -  (I 
r  i+1/ i+1  vn+l 


p 


(a) 

i+l/i 


(5.34) 


The  superscript  "(a)"  implies  the  augmented  system  as  defined  in  (5.31), 
(5.32).  In  the  defining  equations  for  the  augmented  Kalman  filter  the  co- 
variance  matrix  for  the  augmented  error  vector  is 

Pi+l/i+l  ~  E  ^i+l/i+1  '  -i+l^i+l/i+1  ‘  -i+1  ^  <5*35> 
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Using  the  approach  oi  Singer  and  Monzingo  [28]  we  initialize  the 
augmented  Kalman  filler  equations  by  taking  as  the  initial  state  estimate 
lor  the  augmented  state  the  following: 


xo/o  “  ^0 

r  l  , 

r3  „  1 

Xo/o  =  T  1 

2>V2>'-1  +V- 

A  1 

(y0  •  2y.j+y.2> 

X0/0  =  p 

o 

1) 

o 

(5.36) 


where  again  y_2»  y_x  and  yQ  are  the  first,  second  and  third  radar  measure¬ 
ments  received.  The  corresponding  covariance  initialization  matrix  for  the 
augmented  filter  is 
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(5.37) 


The  two  equations  in  (5.34)  loiisiiiuit-  the  Kualti  etjaatiun.-,  that  must 
be  solved  at  each  discrete  lime  instant  to  ol Haiti  the  halntan  weighting  matt  tv, 
.  For  this  simple  example  the  Kalman  filter  computations  are  increased 
significantly  due  to  the  addition  of  the  extra  state  variable  introduced  by  way 
of  the  augmenting  procedure.  For  example,  Williams  [32]  has  shown  that  the 
number  of  multiplications  or  additions  required  to  solve  the  Kalman  equations 
is  given  by  the  result 

N  =  3n^  +  2mn2  +  2m2n  +  2m^  +  n2  +  2mn  (5.38) 

where  x.  is  an  n-vector  and  y.  is  an  m- vector.  Whereas  the  non-augmented 
system  (5.1),  (5.2)  originally  required  a  total  of  N  =  122  multiplications  or 
additions  (since  n=3,  m=l),  the  augmented  system  defined  in  (5.31),  (5.32) 
requires  N=258  multiplications  or  additions  (since  n=4,  m=l).  Clearly  the 
Kalman  filter  computational  requirements  have  been  significantly  increased 
due  to  the  mere  addition  of  a  single  state  variable. 

Design  of  the  minimal- order  observer  for  this  example  uses 
directly  the  "non-augmented"  state  equations  (5.1),  (5.2)  together  with  the 
relation  (5.30).  The  design  procedure  is  described  in  detail  in  Chapter  4. 
Since  the  state  equations  (5.1),  (5.2)  are  already  in  the  desired  observer 
canonical  form,  the  basic  observer  structure  for  this  example  is  identical 
with  that  obtained  in  the  previous  example  1.  [See  equations  (5.10)  through 
(5.14).]  However,  computation  of  the  observer  gain  matrix,  Ki+i, 
is  modified  appropriately  to  account  for  the  non-zero  cross -correlation 
term  That  is,  the  optimal  gain,  Ki+1,  is  obtained  recursively 

using  the  covariance  matrix. 


!‘i  •  AiPiilVVAl'  +  AiViRiVV  +Q,  •  Aipi^'-  "SW 

where  the  cross -covariance  £.w.  *  is  computed  recursively  as  £.+~wi+J ' 

-  fjWj '  *  Qj)  !  i We  shall  omit  the  unnecessary  details  since  the 

solution  of  the  gain  matrix  K.+j  is  quite  similar  to  that  obtained  previously 
in  example  1 .  Using  the  notation  of  the  previous  example  we  obtain  the 
optimal  gain  elements,  k^  and  kj^  ,  in  closed  form  as  follows. 


kO>  =  . 

i+1  i  .2 

“'ll  +0v 


(5.39) 


k(2)  , 

l+l  ' 


“'ll  +av 


(5.40) 


where 


i  i  rp3  i  .  T  g  i 

“il  T  eU  +T  C12  +T  e22 


(*  •  •  4  H 


j  '  -  Te  *  +  ^  e  *  +  ~  €  * 
a12  “  1  11  +  2  12  +  2  22 


‘13  ’  T€12  +  T  C22  '  °v2  (J  ‘  Tkl<1>  '  T  ki2>)ki2> 


(5.41) 


-  T  ewi3  -  -j-  CW23 


In  obtaining  the  above  results  we  have  used  the  notation 


£wlll  ewi2  ew13 


ew21l  ew22l  ew^1 


(5.42) 


where  for  this  example  only  the  elements  ew^1  and  ew^1  are  non-zero  and 
propagate  according  to  the  relations 


“bW=  p[kl«(Tew13  +T  £W23‘)+  +  T  cw23  ] 

L  (5.43) 

cw23l+1  ‘  P[k,+1(2)(T£W13 +T  "23)  +  *w»  '  -j] 


Initialization  of  the  observer  proceeds  as  follows .  The  initial  observer 
error  covariance  matrix  is  of  the  form  '  and  it  is  easy  to 

show  that  for  this  example 


Ci  -  A  M ,An '  +  A^(x_  *  x  ) w  '  +  w  (x  -  xj  'A  '+Q  (5.44) 

o  000  ov-o  — o  — o  — O'— O  —o'  o  O  '  ' 


where  =  E  '  i  and  x^  is  defined  in  (5.8).  Evaluating 

yields  the  result 
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Also,  the  cross -covariance  (x  -  x  )w„  is  found  to  be 
'  o  —o'  — o 


0 

0 

0 

P2Tc  2 

0 

0 

m 

4 

2 

0 

0 

Pa  9 

— T -  +  PO_ 

(5.46) 


Substituting  (5.45)  and  (5.46)  into  (5.44)  yields  the  initialization  matrix  ft  . 

Omitting  the  unnecessary  details,  the  optimal  initializing  gain  elements  k^1 
(2\ 

and  k^  '  are  found  to  be 


<1)  =  . 


21a  2  7o  2T3 

_v_  +  -Jjj - (i  +  p) 


19  c  2  +  ^ - (1  +  P)  +  av2 


10a  2  a  2  9 

— ~  (3  +  5P  +  2P1 

k  (2)  .  .  TZ  _ 

19  0y2+J%—  (l  +  p)  +  av2 


(5.47) 


Finally,  the  elements  ew^1  and  cw 23  given  in  (5.43)  are  initialized  as 


follows: 


T2o  2 
,Cwi3/=  “T21 

T2o  2 


(P2  +  p3)k1(1)+am2T  (p2+|p3) 


(5.48) 


ew  '=  -TS_(P2  +  P3)k,(2)  +  a  2  (p  +  p2+4-) 


1  RESOLUTION  test  chart 

BUREAU  OF  STANDARDS- 1963-A 


5.5  PERFORMANCE  EVALUATION,  EXAMPLE  2 


In  this  example  we  have  assumed  the  radar  range  measurements  are 

independent  from  sample  to  sample  and  the  accuracy  of  the  range  data  is 

ov  =  10  ft.  r.m.s.  For  the  target  model  we  have  taken  the  target  maneuver 
2  2  2 

variance  to  be  =  100  (ft. /sec.  )  and  the  maneuver  time  constant 
(correlation)  has  been  varied  in  parametric  fashion.  More  specifically, 
maneuver  correlations  of  0,  .2,  .4,  .6  and  .8  were  evaluated  in  the  study  and 
the  tracking  data  rate,  T,  was  assumed  to  be  1  second.  In  each  case 
considered,  the  tracking  performance  of  the  4*state  Kalman  filter  and  the 
2* state  minimal-order  observer  was  evaluated.  We  shall  next  present  the 
computer  results  shown  graphically  in  Figures  5.8  through  5.11. 

The  total  mean-square  estimation  error  versus  discrete  time  "i"  for 
both  the  Kalman  filter  and  observer  is  shown  in  Figure  5.8.  Note  in  this 
figure  that  we  have  plotted  trace  E  {(x.  -  Xj)(x.  -  it)'}  versus  "i"  and  there¬ 
fore  the  Kalman  filter  curves  do  not  contain  the  error  contribution  in 
estimating  the  augmented  state  variable,  w- .  Referring  to  Figure  5.8  it  is 
seen  that  the  total  steady-state  mean-square  estimation  error  for  the  observer 
is  increased  from  that  of  the  Kalman  filter  by  5.9%,  5.17%,  5.0%,  6.6%  and 
16.5%  for  target  maneuver  correlations  of  0,  .2,  .4,  .6  and  .8  respectively. 
These  results  indicate  that  the  overall  tracking  performance  is  dependent 
upon  P,  the  maneuver  correlation,  as  is  expected.  From  the  viewpoint  of 
tracking  system  design,  however,  it  is  more  meaningful  to  consider  the 
individual  accuracies  in  target  position  and  velocity  estimates  since  these 
two  quantities  are  the  critical  design  quantities.'  For  this  reason  we  have 
shown  in  Figures  5.9  and  5.10,  respectively,  the  mean  square  errors  in 
target  position  and  velocity.  From  Figure  5.9  it  is  seen  that  Kalman  filtering 


improves  the  initial  measurement  accuracy  of  10  ft.  r .m.s.  to,  at  best, 
about  9  ft.  r.m.s.  in  the  steady  state.  As  stated  previously  in  example  1, 
this  slight  improvement  in  position  accuracy  is  hardly  worth  the  increase  in 
numerical  and  computational  complexities  associated  with  mechanizing  the 
4* state  Kalman  filter.  The  corresponding  mean-square  errors  in  target 
velocity  are  shown  in  Figure  5.10.  From  these  curves  it  is  determined  that 
the  steady-state  accuracy  loss  in  the  velocity  estimate  (ft. /sec.)  incurred 
in  using  the  2-state  observer  instead  of  the  4-state  Kalman  filter  is 
approximately  3.3%,  3.1%,  3.2%,  3.6%  and  6.9%  for  maneuver  correlations 
of  0,  .2,  .4,  .6  and  .8,  respectively.  For  completeness,  we  have  also 
included,  in  Figure  5.11,  the  corresponding  mean-square  error  in  the 
estimate  of  target  acceleration. 

Table  1  shows  the  parametric  w  nhavior  of  the  optimal  observer  gain 
elements,  k.^  and  k.^,  versus  discrete  time  "i"  for  each  of  the  maneuver 
correlations  considered.  The  purpose  of  including  Table  I  in  this  example 
is  to  point  out  the  time-varying  nature  of  the  optimal  observer  solution  which, 
of  course,  is  also  a  fundamental  property  of  the  Kalman  filter.  After  an 
initial  transient  period,  the  error  covariance  matrices  settle  down  and  remain 
constant  and  likewise  the  corresponding  optimal  observer  gain  elements 
remain  constant.  This  same  phenomenon  occurs  in  Kalman  filtering  theory 
for  problems  where  the  system  matrices  (A,  H)  are  time -invariant  and  the 
noise  inputs  are  stationary  stochastic  sequences .  In  examining  Table  1  it 
is  interesting  to  note  that,  generally  speaking,  the  magnitude  of  the  observer 
gain  increases  as  the  correlation  increases  from  ?  =  0  to  c  =  .8.  Also, 
from  Table  1  it  is  seen  that  the  observer  settling  time  tends  to  increase  as 
the  maneuver  time  constant  increases .  The  settling  time  of  the  observer 
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Figure  5.8  Total  Mean-Square  Estimation  Error  vs.  Time  "i." 
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Figure  5,9  Mean-Square  Error  in  Position  vs.  Time 


Figure  5.11  Mean-Square  Error  in  Acceleration  vs.  Time  "i 


Table  5.1.  Observer  Gains  k,'  '  and  k,v  '  Versus 
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Parameters: 

Radar  Measurement  Accuracy,  Oy  =  10  (ft.) 
Target  Maneuver  Variance,  =  100  (ft/sec3) 
Target  Maneuver  Correlation,  -  =  variable 
Data  Rate,  T  =  1  second 


6.  SUMMARY  AND  SUGGESTIONS  FOR  FURTHER  WORt 


t>.  1  SUMMARY  AND  CONCLUSIONS 

This  dissertation  has  considered  the  problem  of  estimating  the  state 
of  a  linear  time -varying  discrete  system  using  an  observer  of  minimum 
dynamic  order.  In  Chapter  3  of  the  dissertation  we  consider  systems  for 
which  the  plant  noise  \v.  and  measurement  noise  are  modeled  as 
Gaussian  white  sequences.  The  effects  of  these  noise  disturbances  upon  the 
estimation  error  are  considered  as  an  integral  part  of  the  fundamental 
development.  The  solution  of  the  observer  design  uses  a  special  linear 
transformation  which  transforms  the  given  state  equations  into  an  equivalent 
state  space  which  is  extremely  convenient  from  the  standpoint  of  observ  er 
design.  Design  of  the  observer  is  then  based  on  a  special  observer  config¬ 
uration  containing  a  free  gain  matrix,  Kj,  which  is  chosen  to  minimize  the 
mean-square  estimation  error  at  time  "i."  The  solution  obtained  is  optimal 
at  each  instant  "i"  and  therefore  is  optimal  both  during  the  transient  period 
and  in  the  steady  state.  Computation  of  this  gain  matrix  is  done 
recursively  as  in  the  Kalman  filter  algorithms,  however,  computationally  the 
solution  is  much  simpler  than  for  the  Kalman  filter.  In  the  special  case  of 
no  measurement  noise,  the  observer  estimation  errors  are  identical  with 
that  of  the  corresponding  Kalman  filter.  The  main  contribution  of  Chapter  3 
is,  therefore,  the  development  of  a  completely  unified  theory  for  the  design 
of  optimal  minimal-order  observers  applicable  to  both  time- varying  and  time- 
invariant  discrete  systems  for  which  the  plant  noise  w.  and  measurement 
noise  v.  are  modeled  as  Gaussian  while  sequences . 
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In  Chapter  4  we  have  extended  the  basic  optimal  minimal-order 
observer  theory  to  cover  that  class  of  systems  for  which  the  noise 
disturbances  w.,^.  are  time-wise  correlated  and  are  modeled  adequately  as 
Causs-Markov  processes.  The  usual  approach  to  this  estimation  problem 
is  to  augment  the  state  vector  and  design  the  estimator  (be  it  a  Kalman  filter, 
observer,  etc.)  to  provide  estimates  of  the  total  augmented  state.  In 
Chapter  4  we  have  utilized  the  basic  observer  structure  developed  in  Chapter  3 
and  have  modified  the  observer  gain  matrix  appropriately  to  obtain  minimum 
mean-square  estimates  of  the  plant  states  without  an  increase  in  the 
dimension  of  the  observer  (i.e.,  the  observer  dimension  remains  "n-m"). 
Along  similar  lines,  we  have  also  considered  the  special  case  whereby  the 
plant  noises  w.  and  v.  are  white  sequences  which  are  crosscorrelated  at 
time  "i"  (that  is,  E{w.Vj '}  =  S.<5.^)  and  have  modified  the  observer  gain 
matrix  appropriately  to  provide  optimal  performance  in  the  mean-square 
sense. 

To  illustrate  the  typical  application  of  the  observer  designs  developed 
in  this  dissertation  we  have  considered,  in  Chapter  5,  the  design  of  a  radar 
tracking  system.  In  the  first  example  we  treat  the  situation  where  the  noises 
w^  and  v.  are  white  sequences .  In  this  example,  the  performance  of  the 
optimal  minimal-order  observer  is  compared  with  that  of  other  estimators 
including  the  Kalman  filter  and  also  several  equal-eigenvalue  observer 
designs.  It  is  shown  that  for  a  typical  set  of  radar  and  target  model  para¬ 
meters  the  optimal  observer  provides  extemely  good  tracking  performance  and 
is  superior  by  far  to  the  equal  eigenvalue  designs  of  Dellon  [10]  and 
Williams  [320.  J  example  r  ve  treat  the  situation  where  the  target 
acceleration  is  mo'L.«d  as  a  time-wise  correlated  noise  sequence.  Here  the 


2-dimensional  optimal  observer  is  compared  with  the  corresponding  4- state 
Kalman  filter  and  it  is  shown  that  the  observer  provides  acceptable  tracking 
performance  over  a  wide  spectrum  of  target  maneuver  time  constants.  The 
examples  of  Chapter  5  clearly  illustrate  the  practicality  of  the  observer 
design  techniques  developed  in  the  dissertation. 

6.2  TOPICS  FOR  FUTURE  INVESTIGATION 

During  the  course  of  performing  this  research  several  closely 
associated  unsolved  problems  of  an  extremely  fundamental  nature  have  been 
uncovered  and  these  problems  might  form  the  basis  for  further  research.  In 
this  dissertation  we  have  considered  only  observers  of  minimal  dynamic 
order.  That  is,  the  dimension  of  the  dynamical  portion  of  the  estimator  is 
"n-m"  where  "n"  is  the  dimension  of  the  state  vector  to  be  estimated  and  "m” 
is  the  number  of  independent  available  outputs.  Since  it  has  been  demonstrated 
quite  vividly  that  the  Kalman  filter  is  an  observer  of  dimension  "n"  and  since 
the  Kalman  filter  provides  the  best  performance  in  terms  of  minimizing  the 
mean-square  estimation  error,  the  idea  of  considering  non-minimal  order 
observers  is  appealing.  (A  non-minimal  order  observer  has  dynamic  order 
greater  than  the  minimal  order  observer  but  less  than  the  Kalman  filter.) 

It  is  conjectured  that  through  the  use  of  non-minimal  order  observers 
the  estimation  error  can  be  reduced  even  further  from  that  attained  with 
the  optimal  minimal-order  observer  developed  in  this  dissertation.  However, 
the  improvement  in  estimation  accuracy  is  undoubtedly  accomplished  only  at 
the  cost  of  increased  complexity.  This  non-minimal  order  observer  would 
have  important  application  in  the  class  of  systems  where  some  of  the  outputs 
are  relatively  noise-free  while  the  remaining  outputs  are  rather  noisy  and 
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mu&t  be  filtered.  In  this  proposed  domain  of  research  the  literature  is 
completely  lacking  and  therefore  it  is  recommended  that  further  work  be  done 
along  these  lines. 

Another  area  of  research  which  appears  to  be  relatively  void  of 
investigation:  is  in  the  area  of  super  low-order  observers.  When  an  estimate 
of  some  fixed  linear  combination  of  states  is  required,  it  is  well  known  21 ' 
that  such  an  estimate  can  be  obtained  using  an  observer  of  order  less  than 
the  minimal  order,  "n-m."  A  consideration  of  the  effects  of  system  noise 
inputs  upon  the  performance  ol  these  so  called  super  low-order  observers 
may  lead  to  an  optimal  design  similar  to  the  optimal  minimal-order  observer 
developed  in  this  dissertation . 

Another  possible  topic  for  future  research  of  a  more  practical  nature 
is  the  design  of  observers  via  the  selection  of  observer  eigenvalues.  To 
date,  most  of  the  literature  pertaining  to  the  design  and  optimization  of 
observer  systems  has  been  concerned  with  the  ability  to  specify,  with 
complete  freedom,  the  choice  of  observer  eigenvalues .  In  fact,  numerous 
researchers  have  been  able  to  demonstrate  through  the  clever  use  of  special 
canonical  forms  that  it  is  possible  to  design  observers  with  completely 
arbitrary  eigenvalues  provided  the  plant  equations  satisfy  the  observability 
criterion.  However,  it  is  clear  that  without  a  thorough  analysis  of  the 
effects  of  noise  the  question  of  where  to  optimally  place  the  observer  eigen¬ 
values  for  reasonable  performance  is  still  unanswered  and  remains  a  per¬ 
plexing  problem  to  the  systems  designer.  It  is  one  thing  to  be  able  to  design 
observer  systems  with  complete  freedom  in  the  choice  of  observer  eigen¬ 
values,  but  it  is  another  to  be  able  to  specify  what  the  eigenvalues  should  be. 
Very  little  has  been  written  about  this  latter  aspect. 


Jn  the  design  ol  an  observer  for  any  given  lixed  plain,  one  po.-siMe 


approach  to  this  eigenvalue  selection  problem  might  be  to  iirst  iuvcstigu'.e 
the  eigenvalues  of  the  corresponding  Kalman  filter  in  oruei  to  establisli  ~>n.c 
guidelines  for  selecting  the  observer  eigenvalues,  in  restricting  the  cla~~  »»; 
admissible  observers  to  be  investigated,  some  fundamental  rules  might  >e 
developed  for  the  optimal  choice  of  observer  eigenvalue.'.  liesuU.-  ■>)  a 
fundamental  nature  are  also  lacking  in  the  domain  of  adaptive  observer  uesign 
wherein  the  choice  of  oliserver  eigenvalues  j->  modified  with  time  in  ar, 
optimal  fashion  according  to  the  noise  statistics,  signal  to  noise  ratio,  or 
some  other  criterion.  Much  research  remains  to  lie  done  in  the  domain  of 
observer  eigenvalue  selection  where  the  minimization  of  noise  effects  upon 
system  performance  is  of  prime  importance . 

Finally,  it  should  be  mentioned  that  the  design  of  the  optimal  minimal- 
order  observer  lor  time-varying  continuous-time  systems  is  still  an  unsolved 
problem.  This  problem  was  investigated  by  Ash  5^  who  considered  the 
design  of  a  minimal-order  observer  for  continuous  time-varying  linear 
systems  (i.e.,  the  eontinuoustime  analog  oj  the  discrete-time  problem 
treated  in  this  dissertation)  with  the  goal  of  obtaining  an  observer  design 
which  minimized  the  effects  of  noise  upon  the  estimation  accuracy  of  the 
observer  derived  estimates.  Ash  proposed  a  suboptimal  trial-and-error-type 
solution  to  the  problem  and  hence  the  results  of  his  work  are  an  "engineering" 
rather  than  a  "mathematical"  solution  to  the  design  problem.  He  was  unable  to 
select  the  free  gain  matrix  K(t)  (analogous  to  the  free  gain  matrix  Ki  of  the 
discrete  observer)  to  absolutely  minimize  the  overall-mean-square 
estimation  error.  It  is  conjectured  that  an  optimal-observer  gain  matrix, 

K*(t),  does  exist  for  the  continuous  time -varying  minimal -order  observer 


100 


and  the  solution  of  this  problem  would  be  an  important  contribution  to  the 
theory . 

One  possible  approach  to  the  solution  ui  this  problem  might  be  to 
discretize  the  continuous  time- varying  slate  equations  obtaining  a  model  for 
the  plant  which  is  valid  at  discrete  intervals  At  seconds  apart.  Then  the 
theory  developed  in  this  dissertation  for  discrete- time  systems  may  be 
applied  to  the  discrete  representation  of  the  plant  and  the  optimal  discrete 
minimal-order  observer  derived.  Taking  the  sample  interval  At  sufficiently 
small  one  would  obtain  a  reasonably  good  approximation  to  the  continuous 
time  problem.  Of  course,  it  is  of  interest  to  obtain  a  closed  form  solution 
for  the  optimal  observer  gain  K*(t)  analogous  to  the  gain  K.*  of  the  discrete 
time  observer.  In  [  15]  Kalman  was  able  to  obtain  the  continuous -time 
Kalman  filter  solution  from  a  consideration  of  the  discretized  model  by 
taking  the  limit  as  At  -  0.  But  even  Kalman  himself  questioned  the  rigor  of 
this  approach  and  in  [18]  Kalman  took  a  more  rigorous  approach  and  solved 
the  Wiener-Hopf  equation  directly  to  obtain  the  continuous  time  version  of 
the  Kalman  filter.  It  is  recommended  that  further  work  be  done  in  the  area  of 
minimal- order  observer  design  for  continuous -time  equations  with  the  goal  of 
determining  the  optimal  time- varying  solution. 
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